Statements (23)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:model
large language model |
| gptkbp:architecture |
gptkb:ELECTRA
|
| gptkbp:author |
gptkb:Kevin_Clark
gptkb:Christopher_D._Manning gptkb:Minh-Thang_Luong gptkb:Quoc_V._Le |
| gptkbp:developedBy |
gptkb:Google_Research
|
| gptkbp:github |
https://github.com/google-research/electra
|
| https://www.w3.org/2000/01/rdf-schema#label |
ELECTRA-Small
|
| gptkbp:language |
English
|
| gptkbp:memiliki_tugas |
natural language understanding
|
| gptkbp:notablePublication |
gptkb:ELECTRA:_Pre-training_Text_Encoders_as_Discriminators_Rather_Than_Generators
|
| gptkbp:openSource |
true
|
| gptkbp:parameter |
14M
|
| gptkbp:pretrainingMethod |
replaced token detection
|
| gptkbp:relatedTo |
gptkb:BERT
gptkb:RoBERTa |
| gptkbp:releaseYear |
2020
|
| gptkbp:trainer |
gptkb:Wikipedia
gptkb:BooksCorpus |
| gptkbp:bfsParent |
gptkb:ELECTRA
|
| gptkbp:bfsLayer |
7
|