Improving Language Understanding by Generative Pre-Training
GPTKB entity
Statements (28)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:academic_journal
|
| gptkbp:arXivID |
1801.06146
|
| gptkbp:author |
gptkb:Ilya_Sutskever
gptkb:Alec_Radford gptkb:Tim_Salimans gptkb:Karthik_Narasimhan |
| gptkbp:citation |
gptkb:Improving_Language_Understanding_by_Generative_Pre-Training
over 10,000 (as of 2024) |
| gptkbp:contribution |
introduction of GPT (Generative Pre-trained Transformer)
|
| gptkbp:field |
natural language processing
|
| gptkbp:focusesOn |
transfer learning
question answering commonsense reasoning text classification language modeling semantic similarity natural language inference |
| https://www.w3.org/2000/01/rdf-schema#label |
Improving Language Understanding by Generative Pre-Training
|
| gptkbp:influenced |
gptkb:GPT-2
gptkb:GPT-3 |
| gptkbp:language |
English
|
| gptkbp:method |
transformer architecture
unsupervised pre-training |
| gptkbp:publicationYear |
2018
|
| gptkbp:publishedBy |
gptkb:OpenAI
|
| gptkbp:url |
https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf
|
| gptkbp:bfsParent |
gptkb:GPT-1
|
| gptkbp:bfsLayer |
6
|