Swin Transformer

E435882

Swin Transformer is a hierarchical vision transformer architecture that uses shifted windows for efficient and scalable image recognition and related computer vision tasks.

All labels observed (8)

How this entity was disambiguated

Statements (51)

Predicate Object
instanceOf hierarchical transformer model
vision transformer architecture
architectureType hierarchical
window-based transformer
benchmarkPerformance state-of-the-art on ADE20K semantic segmentation at introduction
state-of-the-art on COCO object detection at introduction
coAuthor Baining Guo
Han Hu
Stephen Lin
Yixuan Wei
Yue Cao
Yutong Lin
Zheng Zhang
designedFor dense prediction tasks
image recognition
instance segmentation
object detection
semantic segmentation
field computer vision
deep learning
machine learning
firstAuthor Ze Liu
hasComponent MLP feed-forward network
Swin Transformer block
patch merging layer
patch partition layer
window-based multi-head self-attention
hasVariant Swin-B
linked to: Swin Transformer

Swin-L
linked to: Swin Transformer

Swin-S
linked to: Swin Transformer

Swin-T
linked to: Swin Transformer
influenced Swin Transformer V2
linked to: Swin Transformer

window-based vision transformer architectures
inputType image patches
inspiredBy Vision Transformer (ViT)
linked to: ViT
introducedBy Microsoft Research Asia
introducedIn 2021
introducedInPaper Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
linked to: Swin Transformer
keyFeature cross-window connection via window shifting
hierarchical representation
linear computational complexity with image size
local self-attention within windows
shifted window attention
outputType multi-scale feature maps
publishedAt ICCV 2021
usedAs backbone for instance segmentation
backbone for object detection
backbone for semantic segmentation
usesMechanism layer normalization
multi-head self-attention
residual connections

How these facts were elicited

Referenced by (9)

Full triples — surface form annotated when it differs from this entity's canonical label.

ViT hasVariant Swin Transformer
Swin Transformer introducedInPaper Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
linked to: Swin Transformer
Swin Transformer hasVariant Swin-T
linked to: Swin Transformer
Swin Transformer hasVariant Swin-S
linked to: Swin Transformer
Swin Transformer hasVariant Swin-B
linked to: Swin Transformer
Swin Transformer hasVariant Swin-L
linked to: Swin Transformer
Swin Transformer influenced Swin Transformer V2
linked to: Swin Transformer
VisionEncoderDecoderModel supportsEncoderModel SwinModel
linked to: Swin Transformer