DocumentCode :
2619917
Title :
Guessing and entropy
Author :
Massey, James L.
Author_Institution :
Signal & Inf. Process. Lab., Swiss Federal Inst. of Technol., Zurich, Switzerland
fYear :
1994
fDate :
27 Jun-1 Jul 1994
Firstpage :
204
Abstract :
It is shown that the average number of successive guesses, E[G], required with an optimum strategy until one correctly guesses the value of a discrete random X, is underbounded by the entropy H(X) in the manner E[G]⩾(¼)2H(X)+1 provided that H(X)⩾2 bits. This bound is tight within a factor of (4/e) when X is geometrically distributed. It is further shown that E[G] may be arbitrarily large when H(X) is an arbitrarily small positive number so that there is no interesting upper bound on E[G] in terms of H(X)
Keywords :
discrete systems; entropy; random processes; discrete random; entropy; optimum strategy; successive guesses; upper bound; Calculus; Entropy; H infinity control; Probability distribution; Random variables; Upper bound;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Information Theory, 1994. Proceedings., 1994 IEEE International Symposium on
Conference_Location :
Trondheim
Print_ISBN :
0-7803-2015-8
Type :
conf
DOI :
10.1109/ISIT.1994.394764
Filename :
394764
Link To Document :
بازگشت