Title :
Local redundancy and progressive bounds on the redundancy of a Huffman code
Author :
Yeung, Raymond W.
Author_Institution :
AT&T Bell Lab., Holmdel, NJ, USA
fDate :
5/1/1991 12:00:00 AM
Abstract :
The concept of local redundancy is introduced, and it is shown that it is a simple but powerful tool for understanding the redundancy of a prefix code. Based on this concept, the redundancy of a prefix code when the structure of the code is partially known is proven. It is shown how this theorem can be used to obtain well-known lower bounds on RHuff, the redundancy of a Huffman code. The theorem is used to obtain a sequence of new lower bounds on RHuff based on the Huffman procedure. A similar sequence of upper bounds on RHuff is obtained. New lower and upper bounds on RHuff when the two smallest probabilities of the source distribution are known are given as corollaries of these results.
Keywords :
codes; redundancy; Huffman code; local redundancy; prefix code; progressive bounds; Entropy; Information theory; Probability distribution; Random variables; Upper bound;
Journal_Title :
Information Theory, IEEE Transactions on