Title :
Efficient Integer Coding for Arbitrary Probability Distributions
Author :
Yang, Shengtian ; Qiu, Peiliang
Author_Institution :
Dept. of Inf. Sci. & Electron. Eng., Zhejiang Univ., Hangzhou
Abstract :
Performance bounds on the average codeword length of Golomb codes for arbitrary probability distributions are derived in terms of the mean. Then based on Golomb codes, a class of extended gamma codes which are the generalizations of Elias gamma code is constructed and proved to be universal. Optimal decision rules for choosing parameters of Golomb codes and extended gamma codes for arbitrary probability distributions are also derived. Finally, the concept of maximum entropy codes is introduced and the existence of such codes is investigated for source classes with linear constraints. Golomb codes with optimal parameters turn out to be maximum entropy codes for sources with a fixed mean
Keywords :
entropy codes; linear codes; maximum entropy methods; probability; Elias gamma code; Golomb codes; arbitrary probability distribution; average codeword length; decision rules; extended gamma codes; integer coding; linear constraints; maximum entropy codes; Code standards; Data compression; Educational programs; Entropy; Frequency; Information science; Probability distribution; Source coding; Elias gamma code; Golomb codes; universal coding of integers;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2006.878089