|
gptkbp:instanceOf
|
gptkb:large_language_model
|
|
gptkbp:architecture
|
gptkb:transformation
|
|
gptkbp:author
|
gptkb:Kevin_Gimpel
gptkb:Mingda_Chen
gptkb:Piyush_Sharma
gptkb:Radu_Soricut
gptkb:Sebastian_Goodman
gptkb:Zhenzhong_Lan
|
|
gptkbp:availableOn
|
gptkb:Hugging_Face_Model_Hub
gptkb:TensorFlow_Hub
|
|
gptkbp:basedOn
|
gptkb:BERT
|
|
gptkbp:designedFor
|
natural language processing
|
|
gptkbp:developedBy
|
gptkb:Google_Research
|
|
gptkbp:fullName
|
gptkb:A_Lite_BERT
|
|
gptkbp:improves
|
gptkb:BERT_on_GLUE
gptkb:BERT_on_RACE
gptkb:BERT_on_SQuAD
|
|
gptkbp:introducedIn
|
2019
|
|
gptkbp:language
|
English
|
|
gptkbp:license
|
Apache 2.0
|
|
gptkbp:notableFor
|
improved efficiency
state-of-the-art performance
parameter reduction techniques
|
|
gptkbp:notablePublication
|
gptkb:ALBERT:_A_Lite_BERT_for_Self-supervised_Learning_of_Language_Representations
|
|
gptkbp:openSource
|
yes
|
|
gptkbp:pretrained
|
yes
|
|
gptkbp:publishedIn
|
gptkb:ICLR_2020
|
|
gptkbp:uses
|
cross-layer parameter sharing
factorized embedding parameterization
|
|
gptkbp:bfsParent
|
gptkb:Stanford_Question_Answering_Dataset_(SQuAD)
|
|
gptkbp:bfsLayer
|
6
|
|
https://www.w3.org/2000/01/rdf-schema#label
|
ALBERT
|