DocumentCode :
895085
Title :
Extension of an entropy property for binary input memoryless symmetric channels
Author :
Chayat, Naftali ; Shamai, Shlomo
Author_Institution :
Dept. of Electr. Eng., Technion, Haifa, Israel
Volume :
35
Issue :
5
fYear :
1989
fDate :
9/1/1989 12:00:00 AM
Firstpage :
1077
Lastpage :
1079
Abstract :
The channel output entropy property introduced by A.D. Wyner and J. Ziv (ibid., vol.IT-19, p.769-762, Nov.1973) for a binary symmetric channel is extended to arbitrary memoryless symmetric channels with binary inputs and discrete or continuous outputs. This yields lower bounds on the achievable information rates of these channels under constrained binary inputs. Using the interpretation of entropy as a measure of order and randomness, the authors deduce that output sequences of memoryless symmetric channels induced by binary inputs are of a higher degree of randomness if the redundancy of the input binary sequence is spread in memory rather than in one-dimensional asymmetry. It is of interest to characterize the general class of schemes for which this interpretation holds
Keywords :
entropy; information theory; telecommunication channels; achievable information rates; arbitrary memoryless symmetric channels; binary inputs; binary symmetric channel; channel output entropy property; continuous outputs; discrete outputs; lower bounds; randomness; redundancy; Cities and towns; Entropy; Gaussian channels; Information rates; Memoryless systems; Probability density function; Terminology;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/18.42224
Filename :
42224
Link To Document :
بازگشت