Information Theory

GPTKB entity

Statements (94)
Predicate Object
gptkbp:instanceOf gptkb:academic
gptkbp:appliesTo gptkb:machine_learning
biology
computer science
cryptography
data science
economics
linguistics
neuroscience
physics
statistics
telecommunications
gptkbp:foundedBy gptkb:Claude_Shannon
gptkbp:hasApplication gptkb:machine_learning
gptkb:quantum_information_theory
cryptography
data compression
data transmission
error correction
wireless communication
bioinformatics
audio compression
image compression
video compression
network coding
storage systems
neural coding
gptkbp:hasConcept gptkb:Fano's_inequality
gptkb:Kullback-Leibler_divergence
gptkb:Shannon_entropy
gptkb:Rate-distortion_theory
gptkb:Data_compression_theorem
gptkb:Error-correcting_codes
gptkb:Lossy_compression
gptkb:Mutual_information
gptkb:Noisy-channel_coding_theorem
gptkb:Source_coding_theorem
Redundancy
Lossless compression
Channel capacity
Channel coding
Conditional entropy
Information rate
Joint entropy
Relative entropy
Self-information
Source coding
https://www.w3.org/2000/01/rdf-schema#label Information Theory
gptkbp:influencedBy gptkb:mathematics
gptkb:probability_theory
gptkb:statistical_mechanics
electrical engineering
gptkbp:notablePerson gptkb:Claude_Shannon
gptkb:David_Slepian
gptkb:Richard_Hamming
gptkb:Robert_Fano
gptkb:Imre_Csiszár
gptkb:Sergio_Verdú
gptkb:Andrey_Kolmogorov
gptkb:Thomas_Cover
gptkb:Solomon_Kullback
gptkb:Abraham_Wyner
gptkbp:notablePublication gptkb:A_Mathematical_Theory_of_Communication
gptkb:Elements_of_Information_Theory
gptkb:Information_Theory,_Inference,_and_Learning_Algorithms
gptkbp:relatedTo gptkb:Kolmogorov_complexity
gptkb:complexity_theory
gptkb:machine_learning
gptkb:probability_theory
gptkb:signal_processing
gptkb:statistical_mechanics
gptkb:Shannon_theory
coding theory
cryptography
data science
statistics
thermodynamics
algorithmic information theory
gptkbp:studies gptkb:organization
channel capacity
channel coding
communication of information
compression of information
data compression
encoding of information
error correction
mutual information
quantification of information
source coding
storage of information
transmission of information
rate distortion
gptkbp:bfsParent gptkb:communication
gptkbp:bfsLayer 4