OpenAI GPT-2

URI: https://gptkb.org/entity/OpenAI_GPT-2

GPTKB entity

Predicate	Object
gptkbp:instanceOf	large language model
gptkbp:architecture	gptkb:transformation
gptkbp:author	gptkb:Ilya_Sutskever gptkb:Alec_Radford gptkb:Dario_Amodei gptkb:David_Luan gptkb:Rewon_Child gptkb:Jeffrey_Wu
gptkbp:contextWindowSize	1024 tokens
gptkbp:developedBy	gptkb:OpenAI
gptkbp:firstReleased	February 2019
gptkbp:fullModelRelease	November 2019
https://www.w3.org/2000/01/rdf-schema#label	OpenAI GPT-2
gptkbp:input	gptkb:text
gptkbp:language	English
gptkbp:license	gptkb:OpenAI_License
gptkbp:memiliki_tugas	text generation text completion language modeling
gptkbp:notableFor	gptkb:dialogue_systems AI research creative writing translator prototyping data augmentation code generation content creation question answering chatbots text classification text summarization large-scale unsupervised learning paraphrasing story generation text-based games controversy over release due to misuse concerns
gptkbp:notablePublication	gptkb:Language_Models_are_Unsupervised_Multitask_Learners https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
gptkbp:openSource	partially
gptkbp:output	gptkb:text
gptkbp:parameter	1.5 billion
gptkbp:predecessor	gptkb:OpenAI_GPT
gptkbp:releaseDate	2019
gptkbp:size	1.5B 117M 345M 762M
gptkbp:successor	gptkb:OpenAI_GPT-3
gptkbp:tokenizer	byte pair encoding
gptkbp:trainer	WebText dataset
gptkbp:bfsParent	gptkb:OpenAI_GPT-3
gptkbp:bfsLayer	7