Perceiver AR Transformer

GPTKB entity

Statements (28)
Predicate Object
gptkbp:instanceOf gptkb:model
gptkbp:arXivID 2202.07765
gptkbp:author gptkb:Laurens_van_der_Maaten
gptkb:Andrew_Zisserman
gptkb:Oriol_Vinyals
Andrew Jaegle
Carl Doersch
Catalin Ionescu
Jean-Baptiste Alayrac
Joao Carreira
Sebastian Borgeaud
gptkbp:basedOn Perceiver architecture
gptkbp:canBe gptkb:DVD
gptkb:text
audio
images
gptkbp:designedFor autoregressive modeling
gptkbp:developedBy gptkb:DeepMind
gptkbp:handles multimodal data
https://www.w3.org/2000/01/rdf-schema#label Perceiver AR Transformer
gptkbp:improves scalability of transformers
gptkbp:openSource yes
gptkbp:publishedIn 2022
gptkbp:relatedTo gptkb:transformation
gptkb:Perceiver_IO
gptkbp:uses attention mechanism
gptkbp:bfsParent gptkb:Hugging_Face_models
gptkbp:bfsLayer 7