BART

E435868

BART is a sequence-to-sequence transformer model developed by Facebook AI for tasks like text generation, summarization, and translation.

All labels observed (1)

Label Occurrences
BART canonical 2

How this entity was disambiguated

Statements (52)

Predicate Object
instanceOf denoising autoencoder
neural network architecture
sequence-to-sequence transformer model
applicationDomain natural language processing
architectureType encoder-decoder
basedOn Transformer architecture
combinesIdeasFrom BERT
GPT
developer FAIR
Facebook AI
linked to: Meta AI

Facebook AI Research
linked to: Meta AI
hasComponent decoder
encoder
hasVariant BART-base
BART-large
linked to: BART-large-XSum

BART-large-CNN
BART-large-XSum
MBART
linked to: mBART
inputType text
introducedInPaper BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
linked to: mBART
introducedYear 2019
language English
license MIT-like (via Fairseq, depending on distribution)
openSourceImplementation Fairseq
Hugging Face Transformers
optimizationAlgorithm Adam
outputType text
paperAuthors Abdelrahman Mohamed
Luke Zettlemoyer
Marjan Ghazvininejad
Mike Lewis
Naman Goyal
Omer Levy
Veselin Stoyanov
Yinhan Liu
pretrained true
pretrainingStrategy corrupt-then-reconstruct
releasedBy Facebook AI
linked to: Meta AI
supportsTask abstractive summarization
dialogue generation
machine translation
sequence tagging
text classification
text generation
trainingObjective denoising autoencoding
sequence-to-sequence language modeling
usesNoiseType document rotation
sentence permutation
text infilling
token deletion
token masking
usesSubwordTokenization true

How these facts were elicited

Referenced by (2)

Full triples — surface form annotated when it differs from this entity's canonical label.