GPT: Improving Language Understanding by Generative Pre-Training

GPTKB entity

Predicate	Object
gptkbp:instanceOf	gptkb:academic_journal
gptkbp:author	gptkb:Ilya_Sutskever gptkb:Alec_Radford gptkb:Tim_Salimans gptkb:Karthik_Narasimhan
gptkbp:citation	gptkb:Improving_Language_Understanding_by_Generative_Pre-Training https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf
gptkbp:describes	Generative Pre-Training (GPT) model
gptkbp:field	gptkb:Machine_Learning gptkb:Natural_Language_Processing
gptkbp:hasModel	gptkb:transformation
https://www.w3.org/2000/01/rdf-schema#label	GPT: Improving Language Understanding by Generative Pre-Training
gptkbp:impact	foundation for large language models
gptkbp:influenced	gptkb:GPT-2 gptkb:GPT-3 transformer-based language models
gptkbp:language	English
gptkbp:method	Generative pre-training followed by discriminative fine-tuning
gptkbp:proposedBy	unsupervised pre-training for language models
gptkbp:publicationYear	2018
gptkbp:publishedBy	gptkb:OpenAI
gptkbp:bfsParent	gptkb:Attention_Is_All_You_Need
gptkbp:bfsLayer	6