Statements (28)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
large language model
pretrained model |
| gptkbp:architecture |
gptkb:transformation
|
| gptkbp:author |
gptkb:Kyle_Lo
gptkb:Arman_Cohan gptkb:Iz_Beltagy |
| gptkbp:availableOn |
gptkb:Hugging_Face
|
| gptkbp:basedOn |
gptkb:BERT
|
| gptkbp:citation |
gptkb:EMNLP_2019
gptkb:SciBERT:_A_Pretrained_Language_Model_for_Scientific_Text |
| gptkbp:developedBy |
gptkb:Allen_Institute_for_AI
|
| gptkbp:fineTunedWith |
scientific NLP tasks
|
| gptkbp:hasVocabulary |
gptkb:SCIVocab
|
| https://www.w3.org/2000/01/rdf-schema#label |
SciBERT
|
| gptkbp:improves |
gptkb:BERT_(on_scientific_tasks)
|
| gptkbp:language |
English
|
| gptkbp:license |
Apache 2.0
|
| gptkbp:openSource |
true
|
| gptkbp:parameter |
110 million
|
| gptkbp:pretrainingCorpus |
gptkb:Semantic_Scholar
|
| gptkbp:pretrainingCorpusDomain |
computer science
biomedical |
| gptkbp:pretrainingCorpusSize |
1.14 million papers
|
| gptkbp:releaseYear |
2019
|
| gptkbp:trainer |
scientific text
|
| gptkbp:url |
https://github.com/allenai/scibert
|
| gptkbp:bfsParent |
gptkb:large_language_model
|
| gptkbp:bfsLayer |
5
|