• DocumentCode
    1355521
  • Title

    Monotonicity, Thinning, and Discrete Versions of the Entropy Power Inequality

  • Author

    Johnson, Oliver ; Yu, Yaming

  • Author_Institution
    Dept. of Math., Univ. of Bristol, Bristol, UK
  • Volume
    56
  • Issue
    11
  • fYear
    2010
  • Firstpage
    5387
  • Lastpage
    5395
  • Abstract
    We consider the entropy of sums of independent discrete random variables, in analogy with Shannon´s Entropy Power Inequality, where equality holds for normals. In our case, infinite divisibility suggests that equality should hold for Poisson variables. We show that some natural analogues of the EPI do not in fact hold, but propose an alternative formulation which does always hold. The key to many proofs of Shannon´s EPI is the behavior of entropy on scaling of continuous random variables. We believe that Rényi´s operation of thinning discrete random variables plays a similar role to scaling, and give a sharp bound on how the entropy of ultra log-concave random variables behaves on thinning. In the spirit of the monotonicity results established by Artstein, Ball, Barthe, and Naor, we prove a stronger version of concavity of entropy, which implies a strengthened form of our discrete EPI.
  • Keywords
    Poisson distribution; entropy; Poisson distribution; Poisson variables; Rényi operation; Shannon EPI; Shannon entropy power inequality; continuous random variables; independent discrete random variable thinning; ultra log-concave random variables; Context; Convergence; Entropy; Equations; Random variables; Writing; Convolution; Poisson distribution; discrete random variables; entropy; entropy power inequality (EPI); monotonicity; thinning;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2010.2070570
  • Filename
    5605340