• DocumentCode
    3066533
  • Title

    Minimax redundancy for large alphabets

  • Author

    Szpankowski, Wojciech ; Weinberger, Marcelo J.

  • Author_Institution
    Dept. of Comput. Sci., Purdue Univ., West Lafayette, IN, USA
  • fYear
    2010
  • fDate
    13-18 June 2010
  • Firstpage
    1488
  • Lastpage
    1492
  • Abstract
    We study the minimax redundancy of universal coding for large alphabets over memoryless sources and present two main results: We first complete studies initiated in Orlitsky and Santhanam deriving precise asymptotics of the minimax redundancy for all ranges of the alphabet sizes. Second, we consider the minimax redundancy of a source model in which some symbol probabilities are fixed. The latter model leads to an interesting binomial sum asymptotics with super-exponential growth functions. Our findings could be used to approximate numerically the minimax redundancy for various ranges of the sequence length and the alphabet size. These results are obtained by analytic techniques such as tree-like generating functions and the saddle point method.
  • Keywords
    encoding; minimax techniques; redundancy; binomial sum asymptotic; memoryless source; minimax redundancy; universal coding; Binary sequences; Computer science; Entropy; H infinity control; Image coding; Laboratories; Milling machines; Minimax techniques; Speech;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory Proceedings (ISIT), 2010 IEEE International Symposium on
  • Conference_Location
    Austin, TX
  • Print_ISBN
    978-1-4244-7890-3
  • Electronic_ISBN
    978-1-4244-7891-0
  • Type

    conf

  • DOI
    10.1109/ISIT.2010.5513572
  • Filename
    5513572