DocumentCode
923685
Title
Random coding strategies for minimum entropy
Author
Posner, Edward C.
Volume
21
Issue
4
fYear
1975
fDate
7/1/1975 12:00:00 AM
Firstpage
388
Lastpage
391
Abstract
This paper proves that there exists a fixed random coding Strategy for block coding a memoryless information source to achieve the absolute epsilon entropy of the source. That is, the strategy can be chosen independent of the block length. The principal new tool is an easy result on the semicontinuity of the relative entropy functional of one probability distribution with respect to another. The theorem generalizes a result from rate-distortion theory to the "zero-infinity" case.
Keywords
Block codes; Entropy functions; Rate-distortion theory; Source coding; Block codes; Context modeling; Convergence; Entropy; Extraterrestrial measurements; Loss measurement; Memory; Mutual information; Probability distribution; Rate-distortion;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.1975.1055416
Filename
1055416
Link To Document