Title :
A mutual information invariance approach to symmetry in discrete memoryless channels
Author :
Bike Xie ; Wesel, R.
Author_Institution :
Henry Samueli Sch. of Eng. & Appl. Sci., Electr. Eng. Dept., Univ. of California, Los Angeles, Los Angeles, CA
fDate :
Jan. 27 2008-Feb. 1 2008
Abstract :
There are numerous notions of symmetry for discrete memoryless channels. A common goal of these various definitions is that the capacity may be easily computed once the channel is declared to be symmetric. In this paper we focus on a class of definitions of symmetry characterized by the invariance of the channel mutual information over a group of permutations of the input distribution. For definitions of symmetry within this class, we give a simple proof of the optimality of the uniform distribution. The fundamental channels are all symmetric with a general enough definition of symmetry. This paper provides a definition of symmetry that covers these fundamental channels along with a proof that is simple enough to find itself on the chalkboard of even the most introductory class in information theory.
Keywords :
information theory; memoryless systems; statistical distributions; telecommunication channels; discrete memoryless channels; information theory; input distribution; mutual information invariance approach; uniform distribution; Circuit faults; Computed tomography; Current transformers; Fault currents; Memoryless systems; Mutual information; Symmetric matrices;
Conference_Titel :
Information Theory and Applications Workshop, 2008
Conference_Location :
San Diego, CA
Print_ISBN :
978-1-4244-2670-6
DOI :
10.1109/ITA.2008.4601087