Next Sentence Prediction

GPTKB entity

Statements (18)
Predicate Object
gptkbp:instanceOf natural language processing task
gptkbp:alternativeTo Sentence Order Prediction
gptkbp:category sentence relationship modeling
gptkbp:criticizedFor not matching downstream tasks
gptkbp:describedBy gptkb:BERT:_Pre-training_of_Deep_Bidirectional_Transformers_for_Language_Understanding
https://www.w3.org/2000/01/rdf-schema#label Next Sentence Prediction
gptkbp:input pair of sentences
gptkbp:introduced gptkb:Google_AI
gptkbp:introducedIn 2018
gptkbp:label IsNext
NotNext
gptkbp:output binary label
gptkbp:purpose determine if one sentence logically follows another
gptkbp:replacedBy Sentence Order Prediction
gptkbp:usedFor pre-training language models
gptkbp:usedIn gptkb:BERT
gptkbp:bfsParent gptkb:BERT:_Pre-training_of_Deep_Bidirectional_Transformers_for_Language_Understanding
gptkbp:bfsLayer 6