DocumentCode :
3066533
Title :
Minimax redundancy for large alphabets
Author :
Szpankowski, Wojciech ; Weinberger, Marcelo J.
Author_Institution :
Dept. of Comput. Sci., Purdue Univ., West Lafayette, IN, USA
fYear :
2010
fDate :
13-18 June 2010
Firstpage :
1488
Lastpage :
1492
Abstract :
We study the minimax redundancy of universal coding for large alphabets over memoryless sources and present two main results: We first complete studies initiated in Orlitsky and Santhanam deriving precise asymptotics of the minimax redundancy for all ranges of the alphabet sizes. Second, we consider the minimax redundancy of a source model in which some symbol probabilities are fixed. The latter model leads to an interesting binomial sum asymptotics with super-exponential growth functions. Our findings could be used to approximate numerically the minimax redundancy for various ranges of the sequence length and the alphabet size. These results are obtained by analytic techniques such as tree-like generating functions and the saddle point method.
Keywords :
encoding; minimax techniques; redundancy; binomial sum asymptotic; memoryless source; minimax redundancy; universal coding; Binary sequences; Computer science; Entropy; H infinity control; Image coding; Laboratories; Milling machines; Minimax techniques; Speech;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Information Theory Proceedings (ISIT), 2010 IEEE International Symposium on
Conference_Location :
Austin, TX
Print_ISBN :
978-1-4244-7890-3
Electronic_ISBN :
978-1-4244-7891-0
Type :
conf
DOI :
10.1109/ISIT.2010.5513572
Filename :
5513572
Link To Document :
بازگشت