• DocumentCode
    1216760
  • Title

    Crame´r-Rao and moment-entropy inequalities for Renyi entropy and generalized Fisher information

  • Author

    Lutwak, Erwin ; Yang, Deane ; Zhang, Gaoyong

  • Author_Institution
    Dept. of Math., Polytech. Univ., Brooklyn, NY, USA
  • Volume
    51
  • Issue
    2
  • fYear
    2005
  • Firstpage
    473
  • Lastpage
    478
  • Abstract
    The moment-entropy inequality shows that a continuous random variable with given second moment and maximal Shannon entropy must be Gaussian. Stam´s inequality shows that a continuous random variable with given Fisher information and minimal Shannon entropy must also be Gaussian. The Crame´r-Rao inequality is a direct consequence of these two inequalities. In this paper, the inequalities above are extended to Renyi entropy, pth moment, and generalized Fisher information. Generalized Gaussian random densities are introduced and shown to be the extremal densities for the new inequalities. An extension of the Crame´r-Rao inequality is derived as a consequence of these moment and Fisher information inequalities.
  • Keywords
    Gaussian distribution; entropy; Cramer-Rao inequality; Renyi entropy; generalized Fisher information; generalized Gaussian random density; information measure; information theory; moment-entropy inequalities; pth moment; Cramer-Rao bounds; Entropy; Helium; Information theory; Mathematics; Probability distribution; Random variables; Entropy; Fisher information; Renyi entropy; information measure; information theory; moment;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2004.840871
  • Filename
    1386522