BART

E435868

BART is a sequence-to-sequence transformer model developed by Facebook AI for tasks like text generation, summarization, and translation.

All labels observed (1)

Label Occurrences
BART canonical 1

How this entity was disambiguated

Statements (52)

Predicate Object
instanceOf denoising autoencoder
neural network architecture
sequence-to-sequence transformer model
applicationDomain natural language processing
architectureType encoder-decoder
basedOn Transformer architecture
combinesIdeasFrom BERT NERFINISHED
GPT NERFINISHED
developer FAIR NERFINISHED
Facebook AI NERFINISHED
Facebook AI Research NERFINISHED
hasComponent decoder
encoder
hasVariant BART-base NERFINISHED
BART-large NERFINISHED
BART-large-CNN NERFINISHED
BART-large-XSum NERFINISHED
MBART NERFINISHED
inputType text
introducedInPaper BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension NERFINISHED
introducedYear 2019
language English
license MIT-like (via Fairseq, depending on distribution)
openSourceImplementation Fairseq NERFINISHED
Hugging Face Transformers NERFINISHED
optimizationAlgorithm Adam NERFINISHED
outputType text
paperAuthors Abdelrahman Mohamed NERFINISHED
Luke Zettlemoyer NERFINISHED
Marjan Ghazvininejad NERFINISHED
Mike Lewis NERFINISHED
Naman Goyal NERFINISHED
Omer Levy NERFINISHED
Veselin Stoyanov NERFINISHED
Yinhan Liu NERFINISHED
pretrained true
pretrainingStrategy corrupt-then-reconstruct
releasedBy Facebook AI NERFINISHED
supportsTask abstractive summarization
dialogue generation
machine translation
sequence tagging
text classification
text generation
trainingObjective denoising autoencoding
sequence-to-sequence language modeling
usesNoiseType document rotation
sentence permutation
text infilling
token deletion
token masking
usesSubwordTokenization true

How these facts were elicited

Referenced by (1)

Full triples — surface form annotated when it differs from this entity's canonical label.