• DocumentCode
    2602903
  • Title

    A mutual information invariance approach to symmetry in discrete memoryless channels

  • Author

    Bike Xie ; Wesel, R.

  • Author_Institution
    Henry Samueli Sch. of Eng. & Appl. Sci., Electr. Eng. Dept., Univ. of California, Los Angeles, Los Angeles, CA
  • fYear
    2008
  • fDate
    Jan. 27 2008-Feb. 1 2008
  • Firstpage
    444
  • Lastpage
    448
  • Abstract
    There are numerous notions of symmetry for discrete memoryless channels. A common goal of these various definitions is that the capacity may be easily computed once the channel is declared to be symmetric. In this paper we focus on a class of definitions of symmetry characterized by the invariance of the channel mutual information over a group of permutations of the input distribution. For definitions of symmetry within this class, we give a simple proof of the optimality of the uniform distribution. The fundamental channels are all symmetric with a general enough definition of symmetry. This paper provides a definition of symmetry that covers these fundamental channels along with a proof that is simple enough to find itself on the chalkboard of even the most introductory class in information theory.
  • Keywords
    information theory; memoryless systems; statistical distributions; telecommunication channels; discrete memoryless channels; information theory; input distribution; mutual information invariance approach; uniform distribution; Circuit faults; Computed tomography; Current transformers; Fault currents; Memoryless systems; Mutual information; Symmetric matrices;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory and Applications Workshop, 2008
  • Conference_Location
    San Diego, CA
  • Print_ISBN
    978-1-4244-2670-6
  • Type

    conf

  • DOI
    10.1109/ITA.2008.4601087
  • Filename
    4601087