• DocumentCode
    1304229
  • Title

    A binary analog to the entropy-power inequality

  • Author

    Shamai, Shlomo ; Wyner, Aaron D.

  • Author_Institution
    AT&T Bell Lab., Murray Hill, NJ, USA
  • Volume
    36
  • Issue
    6
  • fYear
    1990
  • fDate
    11/1/1990 12:00:00 AM
  • Firstpage
    1428
  • Lastpage
    1430
  • Abstract
    Let {Xn}, {Yn} be independent stationary binary random sequences with entropy H( X), H(Y), respectively. Let h(ζ)=-ζlogζ-(1-ζ)log(1-ζ), 0⩽ζ⩽1/2, be the binary entropy function and let σ(X)=h-1 (H(X)), σ(Y)=h-1 (H(Y)). Let zn=Xn⊕Yn , where ⊕ denotes modulo-2 addition. The following analog of the entropy-power inequality provides a lower bound on H(Z ), the entropy of {Zn}: σ(Z)⩾σ(X)*σ(Y), where σ(Z)=h-1 (H(Z)), and α*β=α(1-β)+β(1-α). When {Y n} are independent identically distributed, this reduces to Mrs. Gerber´s Lemma from A.D. Wyner and J. Ziv (1973)
  • Keywords
    entropy; information theory; random processes; binary analog; entropy-power inequality; independent stationary binary random sequences; information theory; modulo-2 addition; Binary sequences; Cities and towns; Entropy; Probability density function; Random sequences;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.59938
  • Filename
    59938