
AI-created image
Statements (64)
Predicate | Object |
---|---|
gptkbp:instanceOf |
gptkb:academic
|
gptkbp:alternativeName |
information_theory_concept
source_coding_theorem |
gptkbp:appliesTo |
gptkb:machine_learning
biology computer science cryptography data science economics linguistics neuroscience physics statistics telecommunications |
gptkbp:author |
gptkb:Claude_Shannon
|
gptkbp:foundedBy |
gptkb:Claude_Shannon
|
https://www.w3.org/2000/01/rdf-schema#label |
information theory
|
gptkbp:notableIdea |
gptkb:Fisher_information
gptkb:Huffman_coding gptkb:Kolmogorov_complexity gptkb:Kullback-Leibler_divergence gptkb:Shannon–Fano_coding gptkb:Shannon_entropy gptkb:asymptotic_equipartition_property gptkb:information_theory gptkb:noisy-channel_coding_theorem gptkb:rate-distortion_theory channel capacity conditional entropy data compression error-correcting codes information rate joint entropy lossless compression lossy compression mutual information redundancy relative entropy typical set |
gptkbp:originatedIn |
1948
|
gptkbp:publishedIn |
gptkb:A_Mathematical_Theory_of_Communication
|
gptkbp:relatedTo |
gptkb:machine_learning
gptkb:probability_theory gptkb:signal_processing gptkb:statistical_mechanics coding theory cryptography data compression |
gptkbp:studies |
gptkb:organization
channel capacity channel coding communication of information compression of information data redundancy data transmission encoding of information error correction mutual information quantification of information source coding storage of information transmission of information |
gptkbp:bfsParent |
gptkb:Claude_Shannon
|
gptkbp:bfsLayer |
3
|