Statements (21)
Predicate | Object |
---|---|
gptkbp:instanceOf |
mathematical optimization
|
gptkbp:acceleration |
convergence
|
gptkbp:defaultMomentumCoefficient |
0.9
|
https://www.w3.org/2000/01/rdf-schema#label |
Momentum optimizer
|
gptkbp:implementedIn |
gptkb:TensorFlow
gptkb:Keras gptkb:PyTorch |
gptkbp:improves |
gradient descent
|
gptkbp:inspiredBy |
physics
|
gptkbp:introduced |
gptkb:Rumelhart,_Hinton,_and_Williams
|
gptkbp:introducedIn |
1986
|
gptkbp:parameter |
learning rate
momentum coefficient |
gptkbp:reduces |
oscillations
|
gptkbp:relatedTo |
gptkb:Nesterov_accelerated_gradient
|
gptkbp:updateRule |
velocity-based
|
gptkbp:usedIn |
gptkb:machine_learning
deep learning |
gptkbp:variant |
stochastic gradient descent
|
gptkbp:bfsParent |
gptkb:Adam_optimizer
|
gptkbp:bfsLayer |
5
|