Shannon's Entropy

GPTKB entity

Properties (11)
Predicate Object
gptkbp:instanceOf Information Theory
gptkbp:defines gptkb:Claude_Shannon
https://www.w3.org/2000/01/rdf-schema#label Shannon's Entropy
gptkbp:isA Measure of Information
gptkbp:isDiscussedIn Formula_H(X)_=_-Σ_p(x)_log_p(x)
gptkbp:isLocatedIn Bits
gptkbp:isRelatedTo Mutual Information
Kullback-Leibler_Divergence
gptkbp:isUsedIn Cryptography
Data_Compression
gptkbp:measures Uncertainty