|
gptkbp:instanceOf
|
large language model
|
|
gptkbp:architecture
|
gptkb:transformation
|
|
gptkbp:author
|
gptkb:Ilya_Sutskever
gptkb:Alec_Radford
gptkb:Dario_Amodei
gptkb:David_Luan
gptkb:Rewon_Child
gptkb:Jeffrey_Wu
|
|
gptkbp:citation
|
2019
|
|
gptkbp:contextWindowSize
|
1024 tokens
|
|
gptkbp:developedBy
|
gptkb:OpenAI
|
|
gptkbp:hasVariant
|
1.5B
117M
345M
762M
|
|
https://www.w3.org/2000/01/rdf-schema#label
|
GPT-2
|
|
gptkbp:input
|
gptkb:text
|
|
gptkbp:language
|
English
|
|
gptkbp:license
|
gptkb:OpenAI_License
|
|
gptkbp:notableFor
|
gptkb:dialogue_systems
creative writing
research
translator
data augmentation
code generation
content creation
question answering
summarization
chatbots
text completion
semantic search
text classification
controversy over release
demonstrating strong text generation capabilities
information extraction
large-scale unsupervised learning
paraphrasing
story generation
text-based games
|
|
gptkbp:notablePublication
|
gptkb:Language_Models_are_Unsupervised_Multitask_Learners
|
|
gptkbp:openSource
|
partially
|
|
gptkbp:output
|
gptkb:text
|
|
gptkbp:parameter
|
1.5 billion
|
|
gptkbp:predecessor
|
gptkb:GPT
|
|
gptkbp:releaseDate
|
2019
|
|
gptkbp:successor
|
gptkb:GPT-3
|
|
gptkbp:trainer
|
gptkb:WebText
8 million web pages
|
|
gptkbp:uses
|
text generation
text completion
language modeling
|
|
gptkbp:bfsParent
|
gptkb:OpenAI_GPT
gptkb:transformation
gptkb:GPT-3
|
|
gptkbp:bfsLayer
|
5
|