SpanBERT

GPTKB entity

Statements (23)
Predicate Object
gptkbp:instanceOf large language model
gptkbp:author gptkb:Omer_Levy
gptkb:Danqi_Chen
gptkb:Mandar_Joshi
gptkb:Yinhan_Liu
gptkb:Luke_Zettlemoyer
Daniel S. Weld
gptkbp:basedOn gptkb:BERT
gptkbp:designedFor improving span-based predictions
gptkbp:developedBy gptkb:Facebook_AI_Research
https://www.w3.org/2000/01/rdf-schema#label SpanBERT
gptkbp:improves BERT on span-based tasks
gptkbp:introducedIn 2019
gptkbp:language English
gptkbp:notablePublication SpanBERT: Improving Pre-training by Representing and Predicting Spans
gptkbp:pretrainingObjective span masking
gptkbp:publicationDate gptkb:ACL_2020
gptkbp:usedFor natural language processing
question answering
coreference resolution
named entity recognition
gptkbp:bfsParent gptkb:GLUE
gptkbp:bfsLayer 6