Shannon information theory

GPTKB entity

Predicate	Object
gptkbp:instanceOf	gptkb:information_theory gptkb:logic
gptkbp:appliesTo	gptkb:machine_learning computer science cryptography data science statistics telecommunications
gptkbp:basisFor	internet protocols modern telecommunications data compression algorithms error correction codes
gptkbp:focusesOn	gptkb:organization channel capacity data compression error correction mutual information quantification of information communication systems
gptkbp:formedBy	gptkb:Claude_Shannon
gptkbp:hasConcept	gptkb:Shannon_entropy gptkb:information_theory gptkb:noisy-channel_coding_theorem channel capacity redundancy
https://www.w3.org/2000/01/rdf-schema#label	Shannon information theory
gptkbp:influenced	gptkb:artificial_intelligence gptkb:machine_learning coding theory digital communication linguistics modern cryptography neuroscience bioinformatics statistical inference data storage
gptkbp:introducedIn	1948
gptkbp:publishedIn	gptkb:A_Mathematical_Theory_of_Communication
gptkbp:relatedTo	gptkb:Kolmogorov_complexity gptkb:probability_theory gptkb:rate-distortion_theory gptkb:signal_processing gptkb:statistical_mechanics error-correcting codes lossless compression lossy compression thermodynamics algorithmic information theory
gptkbp:bfsParent	gptkb:Algorithmic_Information_Theory_and_Kolmogorov_Complexity gptkb:Algorithmic_Information_Theory gptkb:Holevo's_theorem
gptkbp:bfsLayer	7