Title :
There is no universal source code for an infinite source alphabet
Author :
Györfi, László ; Pali, Istvan ; Van der Meulen, Edward C.
Author_Institution :
Dept. of Math., Tech. Univ. Budapest, Hungary
fDate :
1/1/1994 12:00:00 AM
Abstract :
Shows that a discrete infinite distribution with finite entropy cannot be estimated consistently in information divergence. As a corollary the authors show that there is no universal source code for an infinite source alphabet over the class of all discrete memoryless sources with finite entropy
Keywords :
encoding; entropy; parameter estimation; discrete infinite distribution; discrete memoryless sources; finite entropy; infinite source alphabet; information divergence; universal source code; Decoding; Entropy; Information theory; Mathematics; Probability distribution; Random variables; Source coding;
Journal_Title :
Information Theory, IEEE Transactions on