• DocumentCode
    1409877
  • Title

    On the competitive optimality of Huffman codes

  • Author

    Cover, Thomas M.

  • Author_Institution
    Dept. of Electr. Eng., Stanford Univ., CA, USA
  • Volume
    37
  • Issue
    1
  • fYear
    1991
  • fDate
    1/1/1991 12:00:00 AM
  • Firstpage
    172
  • Lastpage
    174
  • Abstract
    Let X be a discrete random variable drawn according to a probability mass function p(x), and suppose p(x), is dyadic, i.e., log(1/p(x)) is an integer for each x. It is shown that the binary code length assignment l(x)=log(1/p(x)) dominates any other uniquely decodable assignment l´(x) in expected length in the sense that El(X)<El´(X), indicating optimality in long run performance (which is well known), and competitively dominates l´(x), in the sense that Pr{ l (X)<l´(X)}>Pr{l ( X)>l´(X)}, which indicates l is also optimal in the short run. In general, if p is not dyadic then l=[log 1/p] dominates l´+1 in expected length and competitivity dominates l´+1, where l´ is any other uniquely decodable code
  • Keywords
    codes; Huffman codes; binary code length assignment; competitive optimality; discrete random variable; probability mass function; Belts; Binary codes; Data compression; Decoding; Encoding; Information theory; Natural languages; Random variables; Statistics;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.61133
  • Filename
    61133