Statements (50)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
gptkb:Information_theory_concept
|
| gptkbp:application |
Natural language processing
Neuroscience Genomics Clustering Feature selection Image registration |
| gptkbp:describes |
Dependence between random variables
|
| gptkbp:field |
Information theory
Statistics Machine learning |
| gptkbp:form |
I(X;Y) = H(X) + H(Y) - H(X,Y)
I(X;Y) = H(X) - H(X|Y) I(X;Y) = H(Y) - H(Y|X) |
| gptkbp:generalizes |
Conditional mutual information
Multivariate mutual information Normalized mutual information |
| gptkbp:hasUnit |
gptkb:nun
gptkb:Bit |
| gptkbp:introduced |
gptkb:Claude_Shannon
|
| gptkbp:measures |
Amount of information shared between variables
|
| gptkbp:property |
Symmetric
Non-negative Zero if variables are independent |
| gptkbp:relatedTo |
gptkb:Kullback–Leibler_divergence
Entropy Conditional entropy |
| gptkbp:symbol |
I(X;Y)
|
| gptkbp:usedIn |
gptkb:signal_processing
gptkb:Bioinformatics gptkb:Communication_theory gptkb:Systems_biology Time series analysis Speech recognition Cryptography Data visualization Deep learning Medical imaging Data mining Reinforcement learning Econometrics Data compression Causal inference Pattern recognition Statistical inference Network analysis Text mining |
| gptkbp:bfsParent |
gptkb:Information_Theory
|
| gptkbp:bfsLayer |
6
|
| https://www.w3.org/2000/01/rdf-schema#label |
Mutual information
|