DocumentCode
1304229
Title
A binary analog to the entropy-power inequality
Author
Shamai, Shlomo ; Wyner, Aaron D.
Author_Institution
AT&T Bell Lab., Murray Hill, NJ, USA
Volume
36
Issue
6
fYear
1990
fDate
11/1/1990 12:00:00 AM
Firstpage
1428
Lastpage
1430
Abstract
Let {X n}, {Y n} be independent stationary binary random sequences with entropy H ( X ), H (Y ), respectively. Let h (ζ)=-ζlogζ-(1-ζ)log(1-ζ), 0⩽ζ⩽1/2, be the binary entropy function and let σ(X )=h -1 (H (X )), σ(Y )=h -1 (H (Y )). Let z n=X n⊕Y n , where ⊕ denotes modulo-2 addition. The following analog of the entropy-power inequality provides a lower bound on H (Z ), the entropy of {Z n}: σ(Z )⩾σ(X )*σ(Y ), where σ(Z )=h -1 (H (Z )), and α*β=α(1-β)+β(1-α). When {Y n} are independent identically distributed, this reduces to Mrs. Gerber´s Lemma from A.D. Wyner and J. Ziv (1973)
Keywords
entropy; information theory; random processes; binary analog; entropy-power inequality; independent stationary binary random sequences; information theory; modulo-2 addition; Binary sequences; Cities and towns; Entropy; Probability density function; Random sequences;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/18.59938
Filename
59938
Link To Document