DocumentCode :
1216760
Title :
Crame´r-Rao and moment-entropy inequalities for Renyi entropy and generalized Fisher information
Author :
Lutwak, Erwin ; Yang, Deane ; Zhang, Gaoyong
Author_Institution :
Dept. of Math., Polytech. Univ., Brooklyn, NY, USA
Volume :
51
Issue :
2
fYear :
2005
Firstpage :
473
Lastpage :
478
Abstract :
The moment-entropy inequality shows that a continuous random variable with given second moment and maximal Shannon entropy must be Gaussian. Stam´s inequality shows that a continuous random variable with given Fisher information and minimal Shannon entropy must also be Gaussian. The Crame´r-Rao inequality is a direct consequence of these two inequalities. In this paper, the inequalities above are extended to Renyi entropy, pth moment, and generalized Fisher information. Generalized Gaussian random densities are introduced and shown to be the extremal densities for the new inequalities. An extension of the Crame´r-Rao inequality is derived as a consequence of these moment and Fisher information inequalities.
Keywords :
Gaussian distribution; entropy; Cramer-Rao inequality; Renyi entropy; generalized Fisher information; generalized Gaussian random density; information measure; information theory; moment-entropy inequalities; pth moment; Cramer-Rao bounds; Entropy; Helium; Information theory; Mathematics; Probability distribution; Random variables; Entropy; Fisher information; Renyi entropy; information measure; information theory; moment;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/TIT.2004.840871
Filename :
1386522
Link To Document :
بازگشت