Generative Pre-trained Transformer 3

URI: https://gptkb.org/entity/Generative_Pre-trained_Transformer_3

GPTKB entity

Statements (75)

Predicate	Object
gptkbp:instanceOf	large language model
gptkbp:abbreviation	gptkb:GPT-3
gptkbp:abilities	translator code generation question answering summarization text generation
gptkbp:API	gptkb:OpenAI_API
gptkbp:architecture	gptkb:transformation
gptkbp:author	gptkb:Ilya_Sutskever gptkb:Aditya_Ramesh gptkb:Girish_Sastry gptkb:Mark_Chen gptkb:Sandhini_Agarwal gptkb:Gretchen_Krueger gptkb:Ariel_Herbert-Voss gptkb:Arvind_Neelakantan gptkb:Benjamin_Chess gptkb:Benjamin_Mann gptkb:Christopher_Berner gptkb:Christopher_Hesse gptkb:Clemens_Winter gptkb:Daniel_M._Ziegler gptkb:Eric_Sigler gptkb:Mateusz_Litwin gptkb:Melanie_Subbiah gptkb:Nick_Ryder gptkb:Prafulla_Dhariwal gptkb:Pranav_Shyam gptkb:Tom_B._Brown gptkb:Scott_Gray gptkb:Jack_Clark gptkb:Sam_Altman gptkb:Alec_Radford gptkb:Amanda_Askell gptkb:Dario_Amodei gptkb:Jared_Kaplan gptkb:Rewon_Child gptkb:Sam_McCandlish gptkb:Tom_Henighan gptkb:Jeffrey_Wu
gptkbp:citation	over 10,000
gptkbp:developer	gptkb:OpenAI
gptkbp:hardware	gptkb:NVIDIA_V100_GPUs
https://www.w3.org/2000/01/rdf-schema#label	Generative Pre-trained Transformer 3
gptkbp:inputTokenLimit	2048 tokens
gptkbp:language	English
gptkbp:license	proprietary
gptkbp:limitation	hallucination context window limit bias lack of common sense reasoning
gptkbp:notableFeature	few-shot learning one-shot learning zero-shot learning
gptkbp:notableFor	creative writing education research content creation Chatbots programming assistance business automation
gptkbp:parameter	175 billion
gptkbp:pdf	gptkb:Language_Models_are_Few-Shot_Learners
gptkbp:predecessor	gptkb:GPT-2
gptkbp:releaseDate	2020
gptkbp:successor	gptkb:GPT-4
gptkbp:trainer	gptkb:Wikipedia gptkb:Common_Crawl gptkb:WebText Books
gptkbp:trainingCost	several million USD
gptkbp:website	https://openai.com/research/publications/language-models-are-few-shot-learners
gptkbp:bfsParent	gptkb:GPT-3
gptkbp:bfsLayer	5