pretraining objective

8 triples
GPTKB property

Random triples
Subject Object
gptkb:XLNet permutation language modeling
gptkb:Uni_LMv2 masked language modeling
gptkb:Ro_BERTa masked language modeling
gptkb:Uni_LMv1 masked language modeling
gptkb:T5-base Text-to-text
gptkb:Model Masked Language Model
gptkb:Uni_LMv3 masked language modeling
gptkb:Model Next Sentence Prediction