Statements (31)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:stochastic_process
Markov chain |
| gptkbp:canBe |
transient
aperiodic ergodic irreducible recurrent |
| gptkbp:contrastsWith |
gptkb:continuous-time_Markov_chain
|
| gptkbp:hasApplication |
gptkb:information_theory
gptkb:reinforcement_learning computer science economics genetics queueing theory statistical physics |
| gptkbp:hasInitialDistribution |
probability distribution over states
|
| gptkbp:hasProperty |
gptkb:Markov_property
memoryless property discrete time parameter future state depends only on current state |
| gptkbp:hasSpecialCase |
Markov chain
|
| gptkbp:hasStateSpace |
finite or countable set
|
| gptkbp:hasStationaryDistribution |
possible
|
| gptkbp:hasTransitionMatrix |
stochastic matrix
|
| gptkbp:hasTransitionProbability |
P(X_{n+1}=j | X_n=i)
|
| https://www.w3.org/2000/01/rdf-schema#label |
discrete-time Markov chain
|
| gptkbp:namedAfter |
gptkb:Andrey_Markov
|
| gptkbp:studiedIn |
gptkb:probability_theory
stochastic processes |
| gptkbp:bfsParent |
gptkb:Markov_chain
|
| gptkbp:bfsLayer |
5
|