ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

GPTKB entity

Predicate	Object
gptkbp:instanceOf	large language model
gptkbp:abbreviation	gptkb:ALBERT
gptkbp:arXivID	1909.11942
gptkbp:author	gptkb:Kevin_Gimpel gptkb:Mingda_Chen gptkb:Piyush_Sharma gptkb:Radu_Soricut gptkb:Sebastian_Goodman gptkb:Zhenzhong_Lan
gptkbp:basedOn	gptkb:BERT
gptkbp:contribution	cross-layer parameter sharing factorized embedding parameterization parameter reduction techniques inter-sentence coherence loss
gptkbp:developedBy	gptkb:Toyota_Technological_Institute_at_Chicago gptkb:Google_Research
https://www.w3.org/2000/01/rdf-schema#label	ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
gptkbp:improves	gptkb:BERT_on_GLUE gptkb:BERT_on_RACE gptkb:BERT_on_SQuAD
gptkbp:language	English
gptkbp:memiliki_tugas	question answering language understanding natural language inference
gptkbp:openSource	true
gptkbp:publicationYear	2019
gptkbp:repository	https://github.com/google-research/albert
gptkbp:url	https://arxiv.org/abs/1909.11942
gptkbp:bfsParent	gptkb:ALBERT
gptkbp:bfsLayer	6