Solomonoff induction

E774592

Solomonoff induction is a formal theory of universal prediction that combines algorithmic information theory and Bayesian reasoning to define an idealized, incomputable method for inferring future data from past observations.

All labels observed (5)

How this entity was disambiguated

Statements (49)

Predicate Object
instanceOf formal theory of universal prediction
idealized prediction method
incomputable prediction scheme
theory in algorithmic information theory
aimsTo predict future observations from past data
appliesTo online learning scenarios
sequential prediction problems
approximatedBy MDL-based predictors
compression-based prediction methods
resource-bounded variants
assumes data generated by a computable process
basedOn Bayesian mixture of all programs
mixture over all computable hypotheses
componentOf AIXI formalism
linked to: AIXI model
defines universal a priori probability distribution
encodes Occam’s razor via program length prior
field Bayesian statistics
algorithmic information theory
machine learning theory
philosophy of science
formalizedAs universal semimeasure M
goal provide a gold standard for inductive inference
guarantees convergence to true computable distribution
influenced theory of inductive inference
universal artificial intelligence
inspired AIXI
linked to: AIXI model
introducedBy Ray Solomonoff
limitation not computable in practice
minimizes expected log-loss asymptotically
expected number of prediction errors asymptotically
namedAfter Ray Solomonoff
property computably enumerable from below
computationally incomputable
publication A Formal Theory of Inductive Inference
publicationYear 1964
relatedTo Bayesian universal coding
Kolmogorov complexity-based learning
Minimum Description Length principle
satisfies asymptotic optimality in sequence prediction
universal dominance over all computable semimeasures
uses prefix-free Turing machine programs
usesConcept Bayesian updating
Epicurus’ principle of multiple explanations
Kolmogorov complexity
Occam’s razor
linked to: Occam's razor

algorithmic probability
universal Turing machine
linked to: Turing machine

universal prior
weights shorter programs more heavily

How these facts were elicited

Referenced by (13)

Full triples — surface form annotated when it differs from this entity's canonical label.

Marcus Hutter researchInterest Solomonoff induction
Marcus Hutter basedOn Solomonoff induction
universal intelligence measure basedOn Solomonoff induction
Ray Solomonoff notableConcept Solomonoff induction
AIXI basedOn Solomonoff induction
subject linked to: AIXI model
AIXI uses Solomonoff universal prior
subject linked to: AIXI model
linked to: Solomonoff induction
AIXI relatedTo Solomonoff universal distribution
subject linked to: AIXI model
linked to: Solomonoff induction
Solomonoff induction publication A Formal Theory of Inductive Inference
linked to: Solomonoff induction
Solomonoff induction formalizedAs universal semimeasure M
linked to: Solomonoff induction
algorithmic information theory hasKeyConcept Solomonoff induction