IMPALA

E428323

IMPALA is a scalable deep reinforcement learning architecture designed for efficient distributed training of agents across many tasks and environments.

All labels observed (1)

Label Occurrences
IMPALA canonical 2

How this entity was disambiguated

Statements (47)

Predicate Object
instanceOf deep reinforcement learning architecture
distributed reinforcement learning system
scalable RL architecture
affiliation DeepMind Technologies
linked to: DeepMind
architectureType actor-critic
citationVenue ICML 2018
linked to: ICML
comparedWith A2C
A3C
contribution demonstrated scalable distributed deep RL with stable learning
designedFor distributed training of agents
multi-task reinforcement learning
scalable deep reinforcement learning
developedBy DeepMind
enables training with thousands of actors
evaluationDomain Atari
linked to: Atari, Inc.

DeepMind Lab
multi-task environments
field artificial intelligence
deep learning
reinforcement learning
fullName Importance Weighted Actor-Learner Architectures
handles large-scale distributed training
off-policy data
policy lag between actors and learner
hasAlgorithm V-trace
improves data efficiency
scalability
throughput
keyIdea decouple acting from learning via distributed actors and a central learner
use importance weighting to correct for policy lag
language implemented primarily in TensorFlow in the original work
notableComponent V-trace off-policy correction algorithm
optimizationMethod policy gradient
value-based learning
outperforms A2C on large-scale multi-task benchmarks
A3C on large-scale multi-task benchmarks
paperTitle IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures
publishedIn International Conference on Machine Learning
linked to: ICML
supports large-scale experiments
many tasks and environments
multi-task learning
uses V-trace
actor-learner architecture
centralized learner
distributed actors
off-policy correction
yearIntroduced 2018

How these facts were elicited

Referenced by (2)

Full triples — surface form annotated when it differs from this entity's canonical label.