|
gptkbp:instanceOf
|
gptkb:large_language_model
|
|
gptkbp:architecture
|
gptkb:transformation
|
|
gptkbp:author
|
gptkb:Ilya_Sutskever
gptkb:Alec_Radford
gptkb:Dario_Amodei
gptkb:David_Luan
gptkb:Rewon_Child
gptkb:Jeffrey_Wu
|
|
gptkbp:citation
|
2019
|
|
gptkbp:contextWindowSize
|
1024 tokens
|
|
gptkbp:developedBy
|
gptkb:OpenAI
|
|
gptkbp:hasVariant
|
1.5B
117M
345M
762M
|
|
gptkbp:input
|
gptkb:text
|
|
gptkbp:language
|
English
|
|
gptkbp:license
|
gptkb:OpenAI_License
|
|
gptkbp:notableFor
|
gptkb:translator
gptkb:dialogue_systems
gptkb:research
creative writing
data augmentation
code generation
content creation
question answering
summarization
chatbots
text completion
semantic search
text classification
controversy over release
demonstrating strong text generation capabilities
information extraction
large-scale unsupervised learning
paraphrasing
story generation
text-based games
|
|
gptkbp:notablePublication
|
gptkb:Language_Models_are_Unsupervised_Multitask_Learners
|
|
gptkbp:openSource
|
partially
|
|
gptkbp:output
|
gptkb:text
|
|
gptkbp:parameter
|
1.5 billion
|
|
gptkbp:predecessor
|
gptkb:GPT
|
|
gptkbp:releaseDate
|
2019
|
|
gptkbp:successor
|
gptkb:GPT-3
|
|
gptkbp:trainer
|
gptkb:WebText
8 million web pages
|
|
gptkbp:uses
|
text generation
text completion
language modeling
|
|
gptkbp:bfsParent
|
gptkb:OpenAI_GPT
|
|
gptkbp:bfsLayer
|
5
|
|
https://www.w3.org/2000/01/rdf-schema#label
|
GPT-2
|