DocumentCode
1409877
Title
On the competitive optimality of Huffman codes
Author
Cover, Thomas M.
Author_Institution
Dept. of Electr. Eng., Stanford Univ., CA, USA
Volume
37
Issue
1
fYear
1991
fDate
1/1/1991 12:00:00 AM
Firstpage
172
Lastpage
174
Abstract
Let X be a discrete random variable drawn according to a probability mass function p (x ), and suppose p (x ), is dyadic, i.e., log(1/p (x )) is an integer for each x . It is shown that the binary code length assignment l (x )=log(1/p (x )) dominates any other uniquely decodable assignment l ´(x ) in expected length in the sense that El (X )<El ´(X ), indicating optimality in long run performance (which is well known), and competitively dominates l ´(x ), in the sense that Pr{ l (X )<l ´(X )}>Pr{l ( X )>l ´(X )}, which indicates l is also optimal in the short run. In general, if p is not dyadic then l =[log 1/p ] dominates l ´+1 in expected length and competitivity dominates l ´+1, where l ´ is any other uniquely decodable code
Keywords
codes; Huffman codes; binary code length assignment; competitive optimality; discrete random variable; probability mass function; Belts; Binary codes; Data compression; Decoding; Encoding; Information theory; Natural languages; Random variables; Statistics;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/18.61133
Filename
61133
Link To Document