DocumentCode
3066533
Title
Minimax redundancy for large alphabets
Author
Szpankowski, Wojciech ; Weinberger, Marcelo J.
Author_Institution
Dept. of Comput. Sci., Purdue Univ., West Lafayette, IN, USA
fYear
2010
fDate
13-18 June 2010
Firstpage
1488
Lastpage
1492
Abstract
We study the minimax redundancy of universal coding for large alphabets over memoryless sources and present two main results: We first complete studies initiated in Orlitsky and Santhanam deriving precise asymptotics of the minimax redundancy for all ranges of the alphabet sizes. Second, we consider the minimax redundancy of a source model in which some symbol probabilities are fixed. The latter model leads to an interesting binomial sum asymptotics with super-exponential growth functions. Our findings could be used to approximate numerically the minimax redundancy for various ranges of the sequence length and the alphabet size. These results are obtained by analytic techniques such as tree-like generating functions and the saddle point method.
Keywords
encoding; minimax techniques; redundancy; binomial sum asymptotic; memoryless source; minimax redundancy; universal coding; Binary sequences; Computer science; Entropy; H infinity control; Image coding; Laboratories; Milling machines; Minimax techniques; Speech;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory Proceedings (ISIT), 2010 IEEE International Symposium on
Conference_Location
Austin, TX
Print_ISBN
978-1-4244-7890-3
Electronic_ISBN
978-1-4244-7891-0
Type
conf
DOI
10.1109/ISIT.2010.5513572
Filename
5513572
Link To Document