information theory

GPTKB entity
AI-created image of information theory
AI-created image

Statements (64)
Predicate Object
gptkbp:instanceOf gptkb:academic
gptkbp:alternativeName information_theory_concept
source_coding_theorem
gptkbp:appliesTo gptkb:machine_learning
biology
computer science
cryptography
data science
economics
linguistics
neuroscience
physics
statistics
telecommunications
gptkbp:author gptkb:Claude_Shannon
gptkbp:foundedBy gptkb:Claude_Shannon
https://www.w3.org/2000/01/rdf-schema#label information theory
gptkbp:notableIdea gptkb:Fisher_information
gptkb:Huffman_coding
gptkb:Kolmogorov_complexity
gptkb:Kullback-Leibler_divergence
gptkb:Shannon–Fano_coding
gptkb:Shannon_entropy
gptkb:asymptotic_equipartition_property
gptkb:information_theory
gptkb:noisy-channel_coding_theorem
gptkb:rate-distortion_theory
channel capacity
conditional entropy
data compression
error-correcting codes
information rate
joint entropy
lossless compression
lossy compression
mutual information
redundancy
relative entropy
typical set
gptkbp:originatedIn 1948
gptkbp:publishedIn gptkb:A_Mathematical_Theory_of_Communication
gptkbp:relatedTo gptkb:machine_learning
gptkb:probability_theory
gptkb:signal_processing
gptkb:statistical_mechanics
coding theory
cryptography
data compression
gptkbp:studies gptkb:organization
channel capacity
channel coding
communication of information
compression of information
data redundancy
data transmission
encoding of information
error correction
mutual information
quantification of information
source coding
storage of information
transmission of information
gptkbp:bfsParent gptkb:Claude_Shannon
gptkbp:bfsLayer 3