Title :
Extension of an entropy property for binary input memoryless symmetric channels
Author :
Chayat, Naftali ; Shamai, Shlomo
Author_Institution :
Dept. of Electr. Eng., Technion, Haifa, Israel
fDate :
9/1/1989 12:00:00 AM
Abstract :
The channel output entropy property introduced by A.D. Wyner and J. Ziv (ibid., vol.IT-19, p.769-762, Nov.1973) for a binary symmetric channel is extended to arbitrary memoryless symmetric channels with binary inputs and discrete or continuous outputs. This yields lower bounds on the achievable information rates of these channels under constrained binary inputs. Using the interpretation of entropy as a measure of order and randomness, the authors deduce that output sequences of memoryless symmetric channels induced by binary inputs are of a higher degree of randomness if the redundancy of the input binary sequence is spread in memory rather than in one-dimensional asymmetry. It is of interest to characterize the general class of schemes for which this interpretation holds
Keywords :
entropy; information theory; telecommunication channels; achievable information rates; arbitrary memoryless symmetric channels; binary inputs; binary symmetric channel; channel output entropy property; continuous outputs; discrete outputs; lower bounds; randomness; redundancy; Cities and towns; Entropy; Gaussian channels; Information rates; Memoryless systems; Probability density function; Terminology;
Journal_Title :
Information Theory, IEEE Transactions on