DocumentCode :
1409877
Title :
On the competitive optimality of Huffman codes
Author :
Cover, Thomas M.
Author_Institution :
Dept. of Electr. Eng., Stanford Univ., CA, USA
Volume :
37
Issue :
1
fYear :
1991
fDate :
1/1/1991 12:00:00 AM
Firstpage :
172
Lastpage :
174
Abstract :
Let X be a discrete random variable drawn according to a probability mass function p(x), and suppose p(x), is dyadic, i.e., log(1/p(x)) is an integer for each x. It is shown that the binary code length assignment l(x)=log(1/p(x)) dominates any other uniquely decodable assignment l´(x) in expected length in the sense that El(X)<El´(X), indicating optimality in long run performance (which is well known), and competitively dominates l´(x), in the sense that Pr{ l (X)<l´(X)}>Pr{l ( X)>l´(X)}, which indicates l is also optimal in the short run. In general, if p is not dyadic then l=[log 1/p] dominates l´+1 in expected length and competitivity dominates l´+1, where l´ is any other uniquely decodable code
Keywords :
codes; Huffman codes; binary code length assignment; competitive optimality; discrete random variable; probability mass function; Belts; Binary codes; Data compression; Decoding; Encoding; Information theory; Natural languages; Random variables; Statistics;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/18.61133
Filename :
61133
Link To Document :
بازگشت