gptkbp:instance_of
|
gptkb:language
|
gptkbp:bfsLayer
|
4
|
gptkbp:bfsParent
|
gptkb:GPT-3
|
gptkbp:allows
|
Bias in Training Data
|
gptkbp:application
|
gptkb:software
|
gptkbp:architectural_style
|
gptkb:Transformers_character
|
gptkbp:based_on
|
gptkb:Deep_Learning
|
gptkbp:data_usage
|
40 GB
|
gptkbp:developed_by
|
gptkb:Open_AI
|
gptkbp:field_of_study
|
gptkb:Artificial_Intelligence
|
gptkbp:followed_by
|
gptkb:GPT-2
|
gptkbp:has_programs
|
gptkb:musical
gptkb:High_School
gptkb:Educational_Institution
Finance
Healthcare
|
https://www.w3.org/2000/01/rdf-schema#label
|
GPT-1
|
gptkbp:impact
|
AI Research Community
|
gptkbp:improves
|
Previous Models
|
gptkbp:influenced
|
Subsequent GPT Models
|
gptkbp:influenced_by
|
gptkb:BERT
|
gptkbp:input_output
|
gptkb:poet
|
gptkbp:inspired_by
|
gptkb:microprocessor
|
gptkbp:is_available_on
|
gptkb:archive
|
gptkbp:is_cited_in
|
Academic Literature
|
gptkbp:is_compared_to
|
Other Language Models
|
gptkbp:is_considered
|
A Milestone in AI
|
gptkbp:is_discussed_in
|
AI Conferences
|
gptkbp:is_evaluated_by
|
Perplexity
Human Reviewers
Automated Metrics
|
gptkbp:is_open_source
|
False
|
gptkbp:is_part_of
|
gptkb:GPT_Series
Open AI's Research Initiatives
|
gptkbp:is_recognized_for
|
Innovative Approach to Language Understanding
|
gptkbp:is_tasked_with
|
Text Generation
|
gptkbp:is_used_for
|
gptkb:language
gptkb:video_game_series
Chatbots
Question Answering
Text Summarization
|
gptkbp:is_used_in
|
Research Papers
Commercial Applications
|
gptkbp:language
|
English
|
gptkbp:length
|
Variable
|
gptkbp:mission
|
Next Word Prediction
|
gptkbp:notable_feature
|
Generative Pre-training
|
gptkbp:notable_for
|
Pioneering Generative Models
|
gptkbp:orbital_period
|
117 million
|
gptkbp:release_date
|
June 2018
|
gptkbp:requires
|
Large Computational Resources
|
gptkbp:successor
|
gptkb:GPT-2
|
gptkbp:training
|
Unsupervised Learning
Diverse Text Sources
Books Corpus
|
gptkbp:tuning
|
Possible
|
gptkbp:uses
|
Byte Pair Encoding
Self-Attention Mechanism
|