Generative Pre-trained Transformer 1

URI: https://gptkb.org/entity/Generative_Pre-trained_Transformer_1
GPTKB entity
Statements (28)
Predicate Object
gptkbp:instanceOf large language model
gptkbp:abbreviation gptkb:GPT-1
gptkbp:architecture gptkb:transformation
gptkbp:author gptkb:Ilya_Sutskever
gptkb:Alec_Radford
gptkb:Tim_Salimans
gptkb:Karthik_Narasimhan
gptkbp:basedOn transformer architecture
gptkbp:developedBy gptkb:OpenAI
https://www.w3.org/2000/01/rdf-schema#label Generative Pre-trained Transformer 1
gptkbp:influenced gptkb:Generative_Pre-trained_Transformer_2
subsequent GPT models
gptkbp:input gptkb:text
gptkbp:language English
gptkbp:memiliki_tugas text generation
language modeling
unsupervised pretraining
gptkbp:notableFor first GPT model
gptkbp:notablePublication gptkb:Improving_Language_Understanding_by_Generative_Pre-Training
gptkbp:output gptkb:text
gptkbp:parameter 117 million
gptkbp:pdf https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf
gptkbp:pretrainingDataset gptkb:BooksCorpus
gptkbp:pretrainingObjective unsupervised language modeling
gptkbp:releaseYear 2018
gptkbp:successor gptkb:Generative_Pre-trained_Transformer_2
gptkbp:bfsParent gptkb:GPT-1
gptkbp:bfsLayer 6