AdaDelta

GPTKB entity

Statements (19)
Predicate Object
gptkbp:instanceOf gptkb:physicist
gptkbp:developedBy Matthew_D._Zeiler
gptkbp:hasContent traditional gradient descent
https://www.w3.org/2000/01/rdf-schema#label AdaDelta
gptkbp:improves stochastic gradient descent
gptkbp:isAvenueFor gptkb:Adagrad
gptkbp:isBasedOn momentum
gptkbp:isFacilitatedBy sparse data
gptkbp:isLocatedIn gptkb:PyTorch
TensorFlow
gptkbp:isPartOf the family of adaptive learning rate methods
gptkbp:isPopularIn neural network training
gptkbp:isSimilarTo RMSProp
gptkbp:isSuitableFor deep learning
gptkbp:isUsedIn machine learning
gptkbp:reduces the need for manual learning rate tuning
gptkbp:uses adaptive learning rates
gptkbp:worksWith non-stationary objectives
gptkbp:yearEstablished 2012