Statements (23)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
large language model
|
| gptkbp:architecture |
gptkb:transformation
|
| gptkbp:basedOn |
gptkb:BERT
|
| https://www.w3.org/2000/01/rdf-schema#label |
BERT (on scientific tasks)
|
| gptkbp:improves |
baseline BERT for scientific tasks
traditional NLP models on scientific benchmarks |
| gptkbp:language |
English
|
| gptkbp:pretrainedBy |
masked language modeling
next sentence prediction |
| gptkbp:publishedIn |
gptkb:EMNLP
gptkb:ACL |
| gptkbp:relatedTo |
transfer learning
domain adaptation scientific NLP |
| gptkbp:trainer |
scientific corpora
|
| gptkbp:usedFor |
named entity recognition in scientific texts
relation extraction in scientific literature scientific document classification scientific text mining |
| gptkbp:variant |
gptkb:BioBERT
gptkb:SciBERT |
| gptkbp:bfsParent |
gptkb:SciBERT
|
| gptkbp:bfsLayer |
6
|