AI-created image
Statements (22)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:information_theory
|
| gptkbp:alsoKnownAs |
gptkb:organization
|
| gptkbp:appliesTo |
random variables
|
| gptkbp:category |
gptkb:information_theory
gptkb:mathematics statistics |
| gptkbp:describes |
average information content
|
| gptkbp:form |
H(X) = -Σ p(x) log p(x)
|
| https://www.w3.org/2000/01/rdf-schema#label |
Shannon entropy
|
| gptkbp:introducedIn |
gptkb:A_Mathematical_Theory_of_Communication
1948 |
| gptkbp:measures |
bits
|
| gptkbp:namedAfter |
gptkb:Claude_Shannon
|
| gptkbp:relatedTo |
gptkb:Kullback–Leibler_divergence
gptkb:Rényi_entropy mutual information |
| gptkbp:usedIn |
gptkb:machine_learning
gptkb:statistical_mechanics cryptography data compression |
| gptkbp:bfsParent |
gptkb:Claude_Shannon
|
| gptkbp:bfsLayer |
3
|