ViT-S

URI: https://gptkb.org/entity/ViT-S
GPTKB entity
Statements (24)
Predicate Object
gptkbp:instanceOf gptkb:Vision_Transformer_model
gptkbp:activatedBy gptkb:GELU
gptkbp:architecture gptkb:transformation
gptkbp:developedBy gptkb:Google_Research
gptkbp:hasParameterCount 22M
gptkbp:hiddenSize 384
gptkbp:input gptkb:illustrator
gptkbp:introducedIn 2020
gptkbp:level 12
gptkbp:nativeToken Image patches
gptkbp:notableFauna 6
gptkbp:notablePublication gptkb:An_Image_is_Worth_16x16_Words:_Transformers_for_Image_Recognition_at_Scale
gptkbp:openSource gptkb:Hugging_Face_Transformers
timm
gptkbp:relatedTo gptkb:ViT-B
gptkb:ViT-H
gptkb:ViT-L
gptkbp:size 16x16
gptkbp:trainer ImageNet-1k
gptkbp:type Self-attention
gptkbp:usedFor Image classification
gptkbp:bfsParent gptkb:Vision_Transformer
gptkbp:bfsLayer 8
https://www.w3.org/2000/01/rdf-schema#label ViT-S