Statements (30)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
Natural language processing technique
|
| gptkbp:enables |
Language understanding
Contextual word representations Text completion |
| gptkbp:goal |
Predict next word in sequence
|
| https://www.w3.org/2000/01/rdf-schema#label |
Neural language modeling
|
| gptkbp:improves |
Perplexity of language models
|
| gptkbp:input |
Text sequences
|
| gptkbp:notableModel |
gptkb:ELMo
gptkb:LSTM gptkb:BERT gptkb:GPT |
| gptkbp:output |
Probability distribution over vocabulary
|
| gptkbp:popularizedBy |
gptkb:Yoshua_Bengio
2003 |
| gptkbp:relatedTo |
gptkb:Statistical_language_modeling
Deep learning Sequence modeling |
| gptkbp:requires |
Large datasets
High computational resources |
| gptkbp:usedIn |
Speech recognition
Machine translation Text generation Text classification |
| gptkbp:uses |
gptkb:Transformer_models
gptkb:Recurrent_neural_networks Neural networks Word embeddings |
| gptkbp:bfsParent |
gptkb:Language_modeling
|
| gptkbp:bfsLayer |
7
|