Shannon's source coding theorem
GPTKB entity
Statements (23)
Predicate | Object |
---|---|
gptkbp:instanceOf |
gptkb:mathematical_concept
|
gptkbp:alsoKnownAs |
gptkb:noiseless_coding_theorem
|
gptkbp:appliesTo |
discrete memoryless sources
|
gptkbp:field |
gptkb:information_theory
|
gptkbp:form |
L → H(X) as n → ∞
L ≥ H(X) |
gptkbp:formedBy |
gptkb:Claude_Shannon
1948 |
https://www.w3.org/2000/01/rdf-schema#label |
Shannon's source coding theorem
|
gptkbp:implies |
lossless data compression is possible up to the entropy limit
|
gptkbp:influenced |
coding theory
modern digital communication data compression algorithms |
gptkbp:publishedIn |
gptkb:A_Mathematical_Theory_of_Communication
|
gptkbp:relatedTo |
gptkb:Huffman_coding
gptkb:entropy_(information_theory) data compression source coding |
gptkbp:state |
the average length of the optimal code is at least the entropy of the source
for a discrete memoryless source, it is possible to compress data to its entropy rate without loss |
gptkbp:bfsParent |
gptkb:Slepian–Wolf_coding
gptkb:rate-distortion_theory |
gptkbp:bfsLayer |
5
|