Statements (50)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
Information theory concept
|
| gptkbp:application |
Natural language processing
Neuroscience Genomics Clustering Feature selection Image registration |
| gptkbp:describes |
Dependence between random variables
|
| gptkbp:field |
Information theory
Statistics Machine learning |
| gptkbp:form |
I(X;Y) = H(X) + H(Y) - H(X,Y)
I(X;Y) = H(X) - H(X|Y) I(X;Y) = H(Y) - H(Y|X) |
| gptkbp:generalizes |
Conditional mutual information
Multivariate mutual information Normalized mutual information |
| gptkbp:hasUnit |
gptkb:nun
gptkb:Bit |
| https://www.w3.org/2000/01/rdf-schema#label |
Mutual information
|
| gptkbp:introduced |
gptkb:Claude_Shannon
|
| gptkbp:measures |
Amount of information shared between variables
|
| gptkbp:property |
Symmetric
Non-negative Zero if variables are independent |
| gptkbp:relatedTo |
gptkb:Kullback–Leibler_divergence
Entropy Conditional entropy |
| gptkbp:symbol |
I(X;Y)
|
| gptkbp:usedIn |
gptkb:signal_processing
gptkb:Bioinformatics gptkb:Systems_biology Time series analysis Speech recognition Cryptography Data visualization Deep learning Medical imaging Data mining Reinforcement learning Econometrics Data compression Causal inference Pattern recognition Statistical inference Network analysis Text mining Communication theory |
| gptkbp:bfsParent |
gptkb:Information_Theory
|
| gptkbp:bfsLayer |
5
|