SciBERT: A Pretrained Language Model for Scientific Text

GPTKB entity

Statements (20)
Predicate Object
gptkbp:instanceOf gptkb:academic_journal
pretrained language model
gptkbp:author gptkb:Kyle_Lo
gptkb:Arman_Cohan
gptkb:Iz_Beltagy
gptkbp:basedOn BERT architecture
gptkbp:citation high
gptkbp:focusesOn scientific text
https://www.w3.org/2000/01/rdf-schema#label SciBERT: A Pretrained Language Model for Scientific Text
gptkbp:improves BERT on scientific text
gptkbp:language English
gptkbp:openSource true
gptkbp:organization gptkb:Allen_Institute_for_AI
gptkbp:publicationYear 2019
gptkbp:publishedIn gptkb:EMNLP_2019
gptkbp:trainer scientific corpus
gptkbp:url https://arxiv.org/abs/1903.10676
gptkbp:usedFor scientific NLP tasks
gptkbp:bfsParent gptkb:SciBERT
gptkbp:bfsLayer 6