SAC

E426679

SAC (Soft Actor-Critic) is a popular off-policy deep reinforcement learning algorithm that optimizes both expected return and policy entropy to achieve stable and efficient learning in continuous control tasks.

All labels observed (1)

Label Occurrences
SAC canonical 4

How this entity was disambiguated

Statements (49)

Predicate Object
instanceOf deep reinforcement learning algorithm
deep reinforcement learning algorithm
off-policy reinforcement learning algorithm
off-policy reinforcement learning algorithm
abbreviation SAC
advantageOverDeterministicMethods better exploration via entropy maximization
aimsFor sample-efficient learning
stable learning
canBe model-free
category actor-critic methods
commonlyEvaluatedOn MuJoCo benchmarks
linked to: MuJoCo environments

OpenAI Gym continuous control tasks
comparedWith DDPG
TD3
criticUpdateBasedOn soft Bellman backup
firstPublishedIn "Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor"
fullName Soft Actor-Critic
hasVariant automatic entropy tuning SAC
discrete SAC
implementedIn PyTorch
TensorFlow
introducedIn 2018
is maximum entropy reinforcement learning method
laterExtendedIn "Soft Actor-Critic Algorithms and Applications"
linked to: Soft Actor-Critic
learningSignal temporal-difference error
objectiveIncludes temperature parameter
optimizationObjective expected return
policy entropy
policyOutput distribution over continuous actions
policyType stochastic policy
policyUpdateBasedOn reparameterization trick
proposedBy Aurick Zhou
Pieter Abbeel
Sergey Levine
Tuomas Haarnoja
sampleEfficiency high
supports continuous action spaces
temperatureParameterControls entropy-returns trade-off
trainingStability high
typicalDomain continuous control tasks
updateStyle off-policy updates
usedIn autonomous driving research
manipulation tasks
robotics control
uses actor-critic architecture
entropy regularization
replay buffer
target networks
valueFunctionType soft Q-function

How these facts were elicited

Referenced by (4)

Full triples — surface form annotated when it differs from this entity's canonical label.

Soft Actor-Critic abbreviation SAC
subject linked to: SAC