Statements (24)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
Vision Transformer model
|
| gptkbp:activatedBy |
gptkb:GELU
|
| gptkbp:architecture |
gptkb:transformation
|
| gptkbp:developedBy |
gptkb:Google_Research
|
| gptkbp:hasParameterCount |
22M
|
| gptkbp:hiddenSize |
384
|
| https://www.w3.org/2000/01/rdf-schema#label |
ViT-S
|
| gptkbp:input |
gptkb:illustrator
|
| gptkbp:introducedIn |
2020
|
| gptkbp:level |
12
|
| gptkbp:nativeToken |
Image patches
|
| gptkbp:notableFauna |
6
|
| gptkbp:notablePublication |
gptkb:An_Image_is_Worth_16x16_Words:_Transformers_for_Image_Recognition_at_Scale
|
| gptkbp:openSource |
gptkb:Hugging_Face_Transformers
timm |
| gptkbp:relatedTo |
gptkb:ViT-B
gptkb:ViT-H gptkb:ViT-L |
| gptkbp:size |
16x16
|
| gptkbp:trainer |
ImageNet-1k
|
| gptkbp:type |
Self-attention
|
| gptkbp:usedFor |
Image classification
|
| gptkbp:bfsParent |
gptkb:Vision_Transformer
|
| gptkbp:bfsLayer |
6
|