asymptotic equipartition property
GPTKB entity

AI-created image
Statements (19)
Predicate | Object |
---|---|
gptkbp:instanceOf |
gptkb:information_theory
|
gptkbp:abbreviation |
gptkb:AEP
|
gptkbp:appliesTo |
i.i.d. random variables
|
gptkbp:category |
gptkb:probability_theory
gptkb:statistical_mechanics |
gptkbp:describes |
behavior of sequences of random variables
|
gptkbp:field |
gptkb:information_theory
|
gptkbp:form |
-1/n log P(X1,...,Xn) converges to entropy as n increases
|
https://www.w3.org/2000/01/rdf-schema#label |
asymptotic equipartition property
|
gptkbp:implies |
typical set
|
gptkbp:introduced |
gptkb:Claude_Shannon
|
gptkbp:introducedIn |
1948
|
gptkbp:relatedTo |
gptkb:Shannon_entropy
gptkb:law_of_large_numbers |
gptkbp:state |
long sequences of i.i.d. random variables become nearly equiprobable
|
gptkbp:usedIn |
gptkb:information_theory
data compression |
gptkbp:bfsParent |
gptkb:information_theory
|
gptkbp:bfsLayer |
4
|