Unicoder

GPTKB entity

Statements (26)
Predicate Object
gptkbp:instanceOf large language model
gptkbp:arXivID 1909.00964
gptkbp:author gptkb:Yichong_Xu
gptkb:Wei_Chen
gptkb:Tie-Yan_Liu
Minghao Li
Tao Qin
Yingce Xia
Jiang Bian
Jingjing Gong
Lei Shu
gptkbp:availableOn gptkb:GitHub
gptkbp:basedOn transformer architecture
gptkbp:developedBy gptkb:Microsoft_Research_Asia
https://www.w3.org/2000/01/rdf-schema#label Unicoder
gptkbp:notablePublication Unicoder: A Universal Language Encoder by Pre-training with Multiple Cross-lingual Tasks
gptkbp:relatedTo gptkb:XLM
gptkb:XLM-R
gptkb:BERT
gptkbp:releaseYear 2019
gptkbp:supports multilingual understanding
cross-lingual pre-training
gptkbp:supportsLanguage multiple languages
gptkbp:usedFor cross-lingual natural language understanding tasks
gptkbp:bfsParent gptkb:Cross-lingual_Language_Model_Pretraining
gptkbp:bfsLayer 7