DocumentCode
1216760
Title
Crame´r-Rao and moment-entropy inequalities for Renyi entropy and generalized Fisher information
Author
Lutwak, Erwin ; Yang, Deane ; Zhang, Gaoyong
Author_Institution
Dept. of Math., Polytech. Univ., Brooklyn, NY, USA
Volume
51
Issue
2
fYear
2005
Firstpage
473
Lastpage
478
Abstract
The moment-entropy inequality shows that a continuous random variable with given second moment and maximal Shannon entropy must be Gaussian. Stam´s inequality shows that a continuous random variable with given Fisher information and minimal Shannon entropy must also be Gaussian. The Crame´r-Rao inequality is a direct consequence of these two inequalities. In this paper, the inequalities above are extended to Renyi entropy, pth moment, and generalized Fisher information. Generalized Gaussian random densities are introduced and shown to be the extremal densities for the new inequalities. An extension of the Crame´r-Rao inequality is derived as a consequence of these moment and Fisher information inequalities.
Keywords
Gaussian distribution; entropy; Cramer-Rao inequality; Renyi entropy; generalized Fisher information; generalized Gaussian random density; information measure; information theory; moment-entropy inequalities; pth moment; Cramer-Rao bounds; Entropy; Helium; Information theory; Mathematics; Probability distribution; Random variables; Entropy; Fisher information; Renyi entropy; information measure; information theory; moment;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.2004.840871
Filename
1386522
Link To Document