Title :
Crame´r-Rao and moment-entropy inequalities for Renyi entropy and generalized Fisher information
Author :
Lutwak, Erwin ; Yang, Deane ; Zhang, Gaoyong
Author_Institution :
Dept. of Math., Polytech. Univ., Brooklyn, NY, USA
Abstract :
The moment-entropy inequality shows that a continuous random variable with given second moment and maximal Shannon entropy must be Gaussian. Stam´s inequality shows that a continuous random variable with given Fisher information and minimal Shannon entropy must also be Gaussian. The Crame´r-Rao inequality is a direct consequence of these two inequalities. In this paper, the inequalities above are extended to Renyi entropy, pth moment, and generalized Fisher information. Generalized Gaussian random densities are introduced and shown to be the extremal densities for the new inequalities. An extension of the Crame´r-Rao inequality is derived as a consequence of these moment and Fisher information inequalities.
Keywords :
Gaussian distribution; entropy; Cramer-Rao inequality; Renyi entropy; generalized Fisher information; generalized Gaussian random density; information measure; information theory; moment-entropy inequalities; pth moment; Cramer-Rao bounds; Entropy; Helium; Information theory; Mathematics; Probability distribution; Random variables; Entropy; Fisher information; Renyi entropy; information measure; information theory; moment;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2004.840871