Unsupervised Cross-lingual Representation Learning at Scale (Conneau et al., 2020)
GPTKB entity
Statements (25)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:academic_journal
|
| gptkbp:author |
gptkb:Myle_Ott
gptkb:Veselin_Stoyanov gptkb:Francisco_Guzmán gptkb:Guillaume_Wenzek gptkb:Vishrav_Chaudhary gptkb:Alexis_Conneau gptkb:Luke_Zettlemoyer gptkb:Edouard_Grave gptkb:Guillaume_Lample |
| gptkbp:citation |
high (over 2000 as of 2024)
|
| gptkbp:contribution |
Introduced the XLM-R model
Demonstrated large-scale unsupervised cross-lingual pretraining |
| gptkbp:focusesOn |
unsupervised learning
representation learning cross-lingual language models |
| https://www.w3.org/2000/01/rdf-schema#label |
Unsupervised Cross-lingual Representation Learning at Scale (Conneau et al., 2020)
|
| gptkbp:language |
100+
|
| gptkbp:proposesModel |
gptkb:XLM-R
|
| gptkbp:publicationYear |
2020
|
| gptkbp:publishedIn |
gptkb:ACL_2020
|
| gptkbp:trainer |
gptkb:CommonCrawl
|
| gptkbp:url |
https://arxiv.org/abs/1911.02116
|
| gptkbp:bfsParent |
gptkb:Cross-lingual_Language_Model_Pretraining
|
| gptkbp:bfsLayer |
7
|