Neural Probabilistic Language Model
GPTKB entity
AI-created image
Statements (22)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:convolutional_neural_network
large language model |
| gptkbp:author |
gptkb:Pascal_Vincent
gptkb:Yoshua_Bengio gptkb:Christian_Janvin gptkb:Réjean_Ducharme |
| gptkbp:citation |
high
|
| gptkbp:contribution |
improves perplexity over n-gram models
introduced neural networks for language modeling learns distributed word representations |
| gptkbp:field |
gptkb:machine_learning
natural language processing |
| https://www.w3.org/2000/01/rdf-schema#label |
Neural Probabilistic Language Model
|
| gptkbp:influenced |
gptkb:word2vec
modern neural language models |
| gptkbp:input |
word sequences
|
| gptkbp:output |
probability distribution over next word
|
| gptkbp:publicationYear |
2003
|
| gptkbp:publishedIn |
gptkb:Journal_of_Machine_Learning_Research
|
| gptkbp:uses |
gptkb:feedforward_neural_network
|
| gptkbp:bfsParent |
gptkb:Yoshua_Bengio
|
| gptkbp:bfsLayer |
4
|