Statements (52)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
multilingual pre-trained language model
|
| gptkbp:application |
machine translation
cross-lingual understanding multilingual NLP tasks |
| gptkbp:architecture |
BERT-based
|
| gptkbp:arXivID |
2007.07834
|
| gptkbp:author |
gptkb:Hao_Tian
gptkb:Yiming_Yang gptkb:Furu_Wei gptkb:Hangbo_Bao gptkb:Li_Dong gptkb:Ming_Zhou gptkb:Nan_Yang gptkb:Wenhui_Wang gptkb:Xiaodong_Liu gptkb:Xia_Song gptkb:Jianfeng_Gao Lei Cui Shuming Ma |
| gptkbp:developedBy |
gptkb:Microsoft_Research
|
| gptkbp:format |
gptkb:text
text embeddings |
| gptkbp:hasModel |
gptkb:transformation
|
| https://www.w3.org/2000/01/rdf-schema#label |
InfoXLM
|
| gptkbp:improves |
multilingual representation learning
cross-lingual alignment |
| gptkbp:license |
gptkb:MIT_License
|
| gptkbp:notablePublication |
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training
|
| gptkbp:preTrainingObjective |
translation language modeling
cross-lingual masked language modeling |
| gptkbp:publishedIn |
gptkb:arXiv
|
| gptkbp:relatedTo |
gptkb:mBERT
gptkb:XLM-R |
| gptkbp:releaseYear |
2021
|
| gptkbp:repository |
https://github.com/microsoft/InfoXLM
|
| gptkbp:supportsLanguage |
100+ languages
|
| gptkbp:usedFor |
question answering
paraphrase identification semantic textual similarity part-of-speech tagging language modeling machine reading comprehension named entity recognition document classification natural language inference cross-lingual sentiment analysis cross-lingual summarization multilingual classification sentence retrieval zero-shot cross-lingual transfer |
| gptkbp:bfsParent |
gptkb:Cross-lingual_Language_Model_Pretraining
|
| gptkbp:bfsLayer |
7
|