Statements (14)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:mathematical_concept
|
| gptkbp:appliesTo |
probability distributions
|
| gptkbp:field |
gptkb:information_theory
gptkb:probability_theory |
| https://www.w3.org/2000/01/rdf-schema#label |
Gibbs' inequality
|
| gptkbp:implies |
entropy is maximized for the uniform distribution
|
| gptkbp:namedAfter |
gptkb:Josiah_Willard_Gibbs
|
| gptkbp:publishedIn |
various mathematical and information theory texts
|
| gptkbp:relatedTo |
gptkb:Kullback–Leibler_divergence
gptkb:Shannon_entropy |
| gptkbp:state |
The Kullback–Leibler divergence is always non-negative
|
| gptkbp:usedIn |
proof of the non-negativity of relative entropy
|
| gptkbp:bfsParent |
gptkb:Josiah_Willard_Gibbs_Jr.
|
| gptkbp:bfsLayer |
8
|