StochasticWeightAveraging

GPTKB entity

Statements (27)
Predicate Object
gptkbp:instanceOf OptimizationAlgorithm
gptkbp:abbreviation gptkb:SWA
gptkbp:category MachineLearning
NeuralNetworks
gptkbp:describedBy Averaging Weights Leads to Wider Optima and Better Generalization (ICLR 2018)
https://www.w3.org/2000/01/rdf-schema#label StochasticWeightAveraging
gptkbp:hyperparameter AveragingFrequency
AveragingStartEpoch
LearningRate
gptkbp:implementedIn gptkb:TensorFlow
gptkb:PyTorch
gptkbp:improves Generalization
TestAccuracy
gptkbp:proposedBy Andrew Gordon Wilson
Dmitrii Podoprikhin
Dmitry Vetrov
Pavel Izmailov
Timur Garipov
gptkbp:publishedIn gptkb:ICLR_2018
gptkbp:relatedTo AveragedSGD
EnsembleMethods
gptkbp:usedIn DeepLearning
gptkbp:worksWith gptkb:Adam
gptkb:RMSProp
StochasticGradientDescent
gptkbp:bfsParent gptkb:PyTorch_Lightning_Callbacks
gptkbp:bfsLayer 6