Discrete-time Markov chain

GPTKB entity

Statements (31)
Predicate Object
gptkbp:instanceOf gptkb:stochastic_process
Markov chain
gptkbp:hasApplication computer science
economics
genetics
queueing theory
statistical physics
gptkbp:hasProperty gptkb:Markov_property
memoryless property
discrete time parameter
absorbing state (sometimes)
aperiodicity (sometimes)
ergodicity (sometimes)
finite or infinite state space
irreducibility (sometimes)
periodicity (sometimes)
recurrence (sometimes)
stationary distribution (sometimes)
time-homogeneous (sometimes)
transience (sometimes)
gptkbp:hasSpecialCase random walk
birth-death process
gptkbp:hasStateSpace finite or countable set
gptkbp:hasTransitionMatrix stochastic matrix
gptkbp:hasTransitionProbability P(X_{n+1}=j | X_n=i)
https://www.w3.org/2000/01/rdf-schema#label Discrete-time Markov chain
gptkbp:namedAfter gptkb:Andrey_Markov
gptkbp:studiedIn gptkb:probability_theory
stochastic processes
gptkbp:bfsParent gptkb:PRISM_model_checker
gptkbp:bfsLayer 7