|
gptkb:SpanBERT
|
span masking
|
|
gptkb:mBERT
|
next sentence prediction
|
|
gptkb:XLM_(Cross-lingual_Language_Model)
|
translation language modeling
|
|
gptkb:UniLM
|
unified pre-training for language understanding and generation
|
|
gptkb:mT5
|
span corruption
|
|
gptkb:BERT_Large
|
next sentence prediction
|
|
gptkb:RoBERTa
|
masked language modeling
|
|
gptkb:Generative_Pre-trained_Transformer_1
|
unsupervised language modeling
|
|
gptkb:BERT-large
|
masked language modeling
|
|
gptkb:T5_architecture
|
span corruption
|
|
gptkb:XLM_(Cross-lingual_Language_Model)
|
masked language modeling
|
|
gptkb:ProphetNet
|
future n-gram prediction
|
|
gptkb:XLM-RoBERTa
|
masked language modeling
|
|
gptkb:T5
|
span corruption
|
|
gptkb:BERT_Large
|
masked language modeling
|
|
gptkb:BERT-large
|
next sentence prediction
|
|
gptkb:mBERT
|
masked language modeling
|