|
gptkbp:instanceOf
|
large language model
|
|
gptkbp:application
|
machine translation
question answering
summarization
natural language understanding
natural language generation
|
|
gptkbp:architecture
|
gptkb:transformation
|
|
gptkbp:author
|
gptkb:Yu_Wang
gptkb:Furu_Wei
gptkb:Li_Dong
gptkb:Ming_Zhou
gptkb:Nan_Yang
gptkb:Wenhui_Wang
gptkb:Xiaodong_Liu
gptkb:Jianfeng_Gao
gptkb:Hsiao-Wuen_Hon
|
|
gptkbp:citation
|
2000+
|
|
gptkbp:developedBy
|
gptkb:Microsoft_Research_Asia
|
|
gptkbp:firstReleased
|
2019
|
|
gptkbp:fullName
|
Unified Language Model
|
|
https://www.w3.org/2000/01/rdf-schema#label
|
UniLM
|
|
gptkbp:notablePublication
|
Unified Language Model Pre-training for Natural Language Understanding and Generation
|
|
gptkbp:openSource
|
true
|
|
gptkbp:pretrainingObjective
|
unified pre-training for language understanding and generation
|
|
gptkbp:publishedIn
|
gptkb:NeurIPS_2019
|
|
gptkbp:relatedTo
|
gptkb:BERT
gptkb:GPT
gptkb:XLNet
|
|
gptkbp:repository
|
https://github.com/microsoft/unilm
|
|
gptkbp:successor
|
UniLMv2
UniLMv3
|
|
gptkbp:usedFor
|
text generation
language modeling
text comprehension
sequence-to-sequence tasks
|
|
gptkbp:bfsParent
|
gptkb:GLUE
|
|
gptkbp:bfsLayer
|
6
|