Title :
Bounds on the entropy series
Author :
Capocelli, Renato M. ; De Santis, Alfredo ; Taneja, Indeer J.
Author_Institution :
Dept. of Comput. Sci., Oregon State Univ., Corvallis, OR, USA
fDate :
1/1/1988 12:00:00 AM
Abstract :
Upper bounds on the entropy of a countable integer-valued random variable are furnished in terms of the expectation of the logarithm function. In particular, an upper bound is derived that is sharper than that of P. Elias (ibid., vol.IT-21, no.2, p.194-203, 1975), for all values of Ep(log). Bounds that are better only for large values of Ep than the previous known upper bounds are also provided
Keywords :
entropy; information theory; countable integer-valued random variable; entropy series; logarithm function; upper bounds; Computer science; Computer science education; Entropy; Helium; Information theory; Probability distribution; Random variables; Upper bound;
Journal_Title :
Information Theory, IEEE Transactions on
