
AI-created image
Statements (23)
Predicate | Object |
---|---|
gptkbp:instanceOf |
gptkb:mathematical_concept
gptkb:organization |
gptkbp:category |
measure of uncertainty
|
gptkbp:field |
gptkb:information_theory
gptkb:probability_theory statistics |
gptkbp:form |
H_α(X) = (1/(1-α)) log(Σ p_i^α)
|
gptkbp:generalizes |
gptkb:Shannon_entropy
|
https://www.w3.org/2000/01/rdf-schema#label |
Rényi entropy
|
gptkbp:introducedIn |
1961
|
gptkbp:namedAfter |
gptkb:Alfréd_Rényi
|
gptkbp:parameter |
order α
|
gptkbp:reduces |
Hartley entropy when α→0
Shannon entropy when α→1 min-entropy when α→∞ |
gptkbp:relatedTo |
gptkb:Kullback–Leibler_divergence
gptkb:Tsallis_entropy |
gptkbp:usedIn |
gptkb:machine_learning
gptkb:statistical_mechanics gptkb:quantum_information_theory ecology |
gptkbp:bfsParent |
gptkb:Shannon_entropy
|
gptkbp:bfsLayer |
4
|