Recurrent neural network based language model
GPTKB entity
Statements (21)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:convolutional_neural_network
large language model |
| gptkbp:can_be_implemented_with |
gptkb:GRU
gptkb:LSTM |
| gptkbp:developedBy |
2010s
|
| gptkbp:first_major_paper |
Recurrent neural network based language model (Mikolov et al., 2010)
|
| https://www.w3.org/2000/01/rdf-schema#label |
Recurrent neural network based language model
|
| gptkbp:learns |
probability distribution over sequences of words
|
| gptkbp:limitation |
vanishing gradient problem
difficulty modeling long-range dependencies |
| gptkbp:notableContributor |
gptkb:Tomas_Mikolov
|
| gptkbp:predecessor |
n-gram language model
|
| gptkbp:successor |
transformer based language model
|
| gptkbp:trained_with |
gptkb:backpropagation_through_time
|
| gptkbp:usedFor |
machine translation
natural language processing speech recognition text generation |
| gptkbp:uses |
recurrent neural network
|
| gptkbp:bfsParent |
gptkb:Tomas_Mikolov
|
| gptkbp:bfsLayer |
7
|