Title :
Random coding strategies for minimum entropy
Author :
Posner, Edward C.
fDate :
7/1/1975 12:00:00 AM
Abstract :
This paper proves that there exists a fixed random coding Strategy for block coding a memoryless information source to achieve the absolute epsilon entropy of the source. That is, the strategy can be chosen independent of the block length. The principal new tool is an easy result on the semicontinuity of the relative entropy functional of one probability distribution with respect to another. The theorem generalizes a result from rate-distortion theory to the "zero-infinity" case.
Keywords :
Block codes; Entropy functions; Rate-distortion theory; Source coding; Block codes; Context modeling; Convergence; Entropy; Extraterrestrial measurements; Loss measurement; Memory; Mutual information; Probability distribution; Rate-distortion;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.1975.1055416