Monte Carlo tree search

E205830

Monte Carlo tree search is a heuristic search algorithm that uses random sampling of game states to build and explore a search tree, enabling strong decision-making in complex domains like Go and other board games.

All labels observed (7)

How this entity was disambiguated

Statements (49)

Predicate Object
instanceOf Monte Carlo method
decision-making technique
game tree search method
heuristic algorithm
search algorithm
abbreviation MCTS
advantage requires minimal domain knowledge
scales well with additional computation time
appliedIn artificial intelligence research
board games
combinatorial optimization
computer Go
general game playing
planning problems
puzzles
real-time video games
robotics
canUse domain-specific heuristics
neural network policy priors
neural network value functions
developedInContextOf computer Go research
goal select strong actions in complex decision spaces
hasComponent backpropagation phase
expansion phase
selection phase
simulation phase
input current game state
notableUse strong Go programs before deep learning era
oftenUses upper confidence bounds applied to trees
optimizes exploration–exploitation trade-off
output estimated value of positions
recommended move
property anytime algorithm
asymmetric tree growth
can be interrupted at any time with best-so-far move
can handle large branching factors
does not require full game tree enumeration
relatedTo alpha–beta pruning
minimax search
multi-armed bandit problem
upper confidence bound algorithm
requires rollout strategy
simulation policy
usedIn AlphaGo search procedure
AlphaZero search procedure
MuZero search procedure
uses Monte Carlo simulations
playout simulations
random sampling of game states

How these facts were elicited

Referenced by (17)

Full triples — surface form annotated when it differs from this entity's canonical label.

David Silver researchInterest Monte Carlo tree search
AlphaZero basedOn Monte Carlo tree search
MuZero basedOn Monte Carlo Tree Search
linked to: Monte Carlo tree search
MuZero usesAlgorithm Monte Carlo Tree Search
linked to: Monte Carlo tree search
Ioannis Antonoglou researchArea Monte Carlo tree search
AlphaGo Zero basedOn Monte Carlo tree search
Arthur Guez researchInterest Monte Carlo tree search
Arthur Guez coAuthorOf Sample-based Search for Optimal Planning in Markov Decision Processes
linked to: Monte Carlo tree search
Aja Huang areaOfExpertise Monte Carlo tree search
MCTS fullName Monte Carlo Tree Search
linked to: Monte Carlo tree search
MCTS hasVariant Upper Confidence bounds applied to Trees
linked to: Monte Carlo tree search
MCTS hasVariant Rapid Action Value Estimation
linked to: Monte Carlo tree search
MCTS hasVariant Nested Monte Carlo Search
linked to: Monte Carlo tree search
MCTS hasVariant Parallel MCTS
linked to: Monte Carlo tree search
Julian Schrittwieser usesMethod Monte Carlo tree search
Leela Chess Zero usesSearchAlgorithm Monte Carlo tree search
Matthew Lai researchInterest Monte Carlo tree search