GPT-1

GPTKB entity

Statements (58)
Predicate Object
gptkbp:instance_of gptkb:language
gptkbp:bfsLayer 4
gptkbp:bfsParent gptkb:GPT-3
gptkbp:allows Bias in Training Data
gptkbp:application gptkb:software
gptkbp:architectural_style gptkb:Transformers_character
gptkbp:based_on gptkb:Deep_Learning
gptkbp:data_usage 40 GB
gptkbp:developed_by gptkb:Open_AI
gptkbp:field_of_study gptkb:Artificial_Intelligence
gptkbp:followed_by gptkb:GPT-2
gptkbp:has_programs gptkb:musical
gptkb:High_School
gptkb:Educational_Institution
Finance
Healthcare
https://www.w3.org/2000/01/rdf-schema#label GPT-1
gptkbp:impact AI Research Community
gptkbp:improves Previous Models
gptkbp:influenced Subsequent GPT Models
gptkbp:influenced_by gptkb:BERT
gptkbp:input_output gptkb:poet
gptkbp:inspired_by gptkb:microprocessor
gptkbp:is_available_on gptkb:archive
gptkbp:is_cited_in Academic Literature
gptkbp:is_compared_to Other Language Models
gptkbp:is_considered A Milestone in AI
gptkbp:is_discussed_in AI Conferences
gptkbp:is_evaluated_by Perplexity
Human Reviewers
Automated Metrics
gptkbp:is_open_source False
gptkbp:is_part_of gptkb:GPT_Series
Open AI's Research Initiatives
gptkbp:is_recognized_for Innovative Approach to Language Understanding
gptkbp:is_tasked_with Text Generation
gptkbp:is_used_for gptkb:language
gptkb:video_game_series
Chatbots
Question Answering
Text Summarization
gptkbp:is_used_in Research Papers
Commercial Applications
gptkbp:language English
gptkbp:length Variable
gptkbp:mission Next Word Prediction
gptkbp:notable_feature Generative Pre-training
gptkbp:notable_for Pioneering Generative Models
gptkbp:orbital_period 117 million
gptkbp:release_date June 2018
gptkbp:requires Large Computational Resources
gptkbp:successor gptkb:GPT-2
gptkbp:training Unsupervised Learning
Diverse Text Sources
Books Corpus
gptkbp:tuning Possible
gptkbp:uses Byte Pair Encoding
Self-Attention Mechanism