DDPG
E98481
actor-critic algorithm
deep reinforcement learning algorithm
model-free reinforcement learning method
off-policy reinforcement learning method
DDPG (Deep Deterministic Policy Gradient) is a model-free, off-policy deep reinforcement learning algorithm designed for continuous action spaces, combining ideas from DQN and actor-critic methods.
All labels observed (6)
How this entity was disambiguated
This entity first appeared as the object of triple T824092 — resolving that mention is where its identity was fixed. The disambiguator weighed these candidate entities and picked the highlighted one (or “None”, minting a new entity). This is how homonymy is resolved: the same surface form can point to different entities.
NED1
Entity disambiguation (via context triple)
gpt-5-mini-2025-08-07
Target entity: DDPG Context triple: [OpenAI Baselines, implementsAlgorithm, DDPG]
-
A.
Atari deep Q-network
The Atari deep Q-network is a pioneering deep reinforcement learning system that learned to play a wide range of Atari 2600 video games directly from raw pixels at human-level or better performance.
-
B.
DRL
DRL is the U.S. State Department bureau responsible for promoting democracy, protecting human rights, and advancing labor rights worldwide.
-
C.
OpenAI Baselines
OpenAI Baselines is a collection of high-quality reference implementations of reinforcement learning algorithms released by OpenAI for research and benchmarking.
-
D.
MuZero
MuZero is a DeepMind reinforcement learning algorithm that learns to plan and master complex games like Go, chess, and Atari without being given the rules in advance.
-
E.
Arcade Learning Environment
Arcade Learning Environment is a widely used research platform that provides a suite of Atari 2600 games for developing and evaluating reinforcement learning algorithms.
- F. None of above. chosen
- G. Unsure - the case is ambiguous/there is not enough information to decide.
NED2
Entity disambiguation (via description)
gpt-5-mini-2025-08-07
Target entity: DDPG Target entity description: DDPG (Deep Deterministic Policy Gradient) is a model-free, off-policy deep reinforcement learning algorithm designed for continuous action spaces, combining ideas from DQN and actor-critic methods.
-
A.
Atari deep Q-network
The Atari deep Q-network is a pioneering deep reinforcement learning system that learned to play a wide range of Atari 2600 video games directly from raw pixels at human-level or better performance.
-
B.
DRL
DRL is the U.S. State Department bureau responsible for promoting democracy, protecting human rights, and advancing labor rights worldwide.
-
C.
OpenAI Baselines
OpenAI Baselines is a collection of high-quality reference implementations of reinforcement learning algorithms released by OpenAI for research and benchmarking.
-
D.
MuZero
MuZero is a DeepMind reinforcement learning algorithm that learns to plan and master complex games like Go, chess, and Atari without being given the rules in advance.
-
E.
Arcade Learning Environment
Arcade Learning Environment is a widely used research platform that provides a suite of Atari 2600 games for developing and evaluating reinforcement learning algorithms.
- F. None of above. chosen
Statements (50)
| Predicate | Object |
|---|---|
| instanceOf |
actor-critic algorithm
ⓘ
deep reinforcement learning algorithm ⓘ model-free reinforcement learning method ⓘ off-policy reinforcement learning method ⓘ |
| actorObjective | maximize critic-estimated Q-value ⓘ |
| algorithmFamily |
Q-learning inspired methods
ⓘ
policy gradient methods ⓘ |
| basedOn | deterministic policy gradient theorem ⓘ |
| category | continuous-action RL algorithm ⓘ |
| commonlyEvaluatedOn |
MuJoCo benchmarks
ⓘ
OpenAI Gym continuous control environments ⓘ |
| commonlyUsedFor | continuous control tasks ⓘ |
| contrastWith |
DQN (which handles discrete actions)
ⓘ
linked to:
Atari deep Q-network
stochastic policy gradient methods ⓘ |
| criticLossType | temporal-difference error ⓘ |
| criticObjective | minimize Bellman error ⓘ |
| explorationStrategy | noise added to deterministic policy output ⓘ |
| fullName |
Deep Deterministic Policy Gradient
ⓘ
linked to:
DDPG
|
| handlesActionSpaceType | continuous action space ⓘ |
| inputToActor | state ⓘ |
| inputToCritic | state-action pair ⓘ |
| inspiredBy |
Deep Q-Network
ⓘ
linked to:
Atari deep Q-network
|
| introducedBy |
Alexander Pritzel
ⓘ
Daan Wierstra ⓘ David Silver ⓘ Jonathan J. Hunt ⓘ Nicolas Heess ⓘ Timothy P. Lillicrap ⓘ Tom Erez ⓘ Yuval Tassa ⓘ |
| introducedInPaper |
Continuous control with deep reinforcement learning
ⓘ
linked to:
DDPG
|
| introducedInYear | 2015 ⓘ |
| optimizationMethod | gradient descent ⓘ |
| outputOfActor | continuous action ⓘ |
| outputOfCritic | Q-value ⓘ |
| policyType | deterministic policy ⓘ |
| stabilityTechnique |
experience replay
ⓘ
target networks ⓘ |
| trainingParadigm | off-policy learning ⓘ |
| updateType | bootstrapped TD learning ⓘ |
| uses |
Ornstein-Uhlenbeck noise
ⓘ
linked to:
Ornstein–Uhlenbeck process
actor network ⓘ critic network ⓘ experience replay buffer ⓘ exploration noise process ⓘ soft target updates ⓘ target actor network ⓘ target critic network ⓘ |
| usesFunctionApproximator | deep neural network ⓘ |
| valueFunctionType | action-value function ⓘ |
How these facts were elicited
The pipeline generated the facts above by prompting gpt-5.1 with this entity's name + description and the instruction below.
Instruction
You are a knowledge base construction expert. Given a subject entity and a description of it, return factual statements that you know for the subject as a JSON list of dictionaries(triples), where keys must be "subject", "predicate" and "object". The number of facts may be very high, between 25 to 50 or more, for very popular subjects. For less popular subjects, the number of facts can be very low, like 5 or 10. # Requirements - If you don't know the subject at all, return an empty list. - If the subject is not a named entity, return an empty list. - Include at least one triple where predicate is "instanceOf". - Do not get too wordy. - Separate several objects into multiple triples with one object.
Input
Subject: DDPG Description of subject: DDPG (Deep Deterministic Policy Gradient) is a model-free, off-policy deep reinforcement learning algorithm designed for continuous action spaces, combining ideas from DQN and actor-critic methods.
Referenced by (26)
Full triples — surface form annotated when it differs from this entity's canonical label.