DocumentCode
2602903
Title
A mutual information invariance approach to symmetry in discrete memoryless channels
Author
Bike Xie ; Wesel, R.
Author_Institution
Henry Samueli Sch. of Eng. & Appl. Sci., Electr. Eng. Dept., Univ. of California, Los Angeles, Los Angeles, CA
fYear
2008
fDate
Jan. 27 2008-Feb. 1 2008
Firstpage
444
Lastpage
448
Abstract
There are numerous notions of symmetry for discrete memoryless channels. A common goal of these various definitions is that the capacity may be easily computed once the channel is declared to be symmetric. In this paper we focus on a class of definitions of symmetry characterized by the invariance of the channel mutual information over a group of permutations of the input distribution. For definitions of symmetry within this class, we give a simple proof of the optimality of the uniform distribution. The fundamental channels are all symmetric with a general enough definition of symmetry. This paper provides a definition of symmetry that covers these fundamental channels along with a proof that is simple enough to find itself on the chalkboard of even the most introductory class in information theory.
Keywords
information theory; memoryless systems; statistical distributions; telecommunication channels; discrete memoryless channels; information theory; input distribution; mutual information invariance approach; uniform distribution; Circuit faults; Computed tomography; Current transformers; Fault currents; Memoryless systems; Mutual information; Symmetric matrices;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory and Applications Workshop, 2008
Conference_Location
San Diego, CA
Print_ISBN
978-1-4244-2670-6
Type
conf
DOI
10.1109/ITA.2008.4601087
Filename
4601087
Link To Document