|
gptkbp:instanceOf
|
gptkb:large_language_model
|
|
gptkbp:architecture
|
gptkb:transformation
|
|
gptkbp:author
|
gptkb:Ilya_Sutskever
gptkb:Alec_Radford
gptkb:Dario_Amodei
gptkb:David_Luan
gptkb:Rewon_Child
gptkb:Jeffrey_Wu
|
|
gptkbp:contextWindowSize
|
1024 tokens
|
|
gptkbp:developedBy
|
gptkb:OpenAI
|
|
gptkbp:firstReleased
|
February 2019
|
|
gptkbp:fullModelRelease
|
November 2019
|
|
gptkbp:input
|
gptkb:text
|
|
gptkbp:language
|
English
|
|
gptkbp:license
|
gptkb:OpenAI_License
|
|
gptkbp:memiliki_tugas
|
text generation
text completion
language modeling
|
|
gptkbp:notableFor
|
gptkb:translator
gptkb:dialogue_systems
AI research
creative writing
prototyping
data augmentation
code generation
content creation
question answering
chatbots
text classification
text summarization
large-scale unsupervised learning
paraphrasing
story generation
text-based games
controversy over release due to misuse concerns
|
|
gptkbp:notablePublication
|
gptkb:Language_Models_are_Unsupervised_Multitask_Learners
https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
|
|
gptkbp:openSource
|
partially
|
|
gptkbp:output
|
gptkb:text
|
|
gptkbp:parameter
|
1.5 billion
|
|
gptkbp:predecessor
|
gptkb:OpenAI_GPT
|
|
gptkbp:releaseDate
|
2019
|
|
gptkbp:size
|
1.5B
117M
345M
762M
|
|
gptkbp:successor
|
gptkb:OpenAI_GPT-3
|
|
gptkbp:tokenizer
|
byte pair encoding
|
|
gptkbp:trainer
|
WebText dataset
|
|
gptkbp:bfsParent
|
gptkb:OpenAI_GPT-3
|
|
gptkbp:bfsLayer
|
8
|
|
https://www.w3.org/2000/01/rdf-schema#label
|
OpenAI GPT-2
|