mBART

E435877

mBART is a multilingual sequence-to-sequence Transformer model designed for tasks like machine translation and text generation across many languages.

All labels observed (5)

How this entity was disambiguated

Statements (45)

Predicate Object
instanceOf Transformer model
denoising autoencoder
multilingual sequence-to-sequence model
neural machine translation model
architectureType encoder-decoder
basedOn Transformer architecture
category large language model
multilingual language model
designedFor cross-lingual transfer
low-resource machine translation
developer Facebook AI
linked to: Meta AI

Meta AI
hasComponent Transformer decoder
Transformer encoder
hasVariant mBART-25
linked to: mBART

mBART-50
linked to: mBART
implementedIn Hugging Face Transformers
fairseq
linked to: Fairseq
inputRepresentation language-specific tokens
shared subword vocabulary
inputType text
introducedIn research paper
languageCoverage multilingual
learningParadigm encoder-decoder pretraining
license Apache-2.0 (via common implementations)
notableProperty single model for many translation directions
strong performance on low-resource languages
optimizationAlgorithm Adam
outputType text
paperTitle Multilingual Denoising Pre-training for Neural Machine Translation
pretrainedOn large multilingual corpora
pretrainingType self-supervised learning
releaseYear 2020
supports many languages
supportsTask denoising
machine translation
sequence-to-sequence learning
summarization
text generation
trainingObjective denoising autoencoding
reconstructing original text from noisy input
typicalUse fine-tuning for specific translation directions
zero-shot translation
uses Transformer attention mechanisms
subword tokenization

How these facts were elicited

Referenced by (5)

Full triples — surface form annotated when it differs from this entity's canonical label.

BART hasVariant MBART
linked to: mBART
BART introducedInPaper BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
linked to: mBART
mBART hasVariant mBART-50
linked to: mBART
mBART hasVariant mBART-25
linked to: mBART