• DocumentCode
    2421841
  • Title

    The common information of N dependent random variables

  • Author

    Liu, Wei ; Xu, Ge ; Chen, Biao

  • Author_Institution
    Dept. of EECS, Syracuse Univ., Syracuse, NY, USA
  • fYear
    2010
  • fDate
    Sept. 29 2010-Oct. 1 2010
  • Firstpage
    836
  • Lastpage
    843
  • Abstract
    This paper generalizes Wyner´s definition of common information of a pair of random variables to that of N random variables. We prove coding theorems that show the same operational meanings for the common information of two random variables generalize to that of N random variables. As a byproduct of our proof, we show that the Gray-Wyner source coding network can be generalized to N source sequences with N decoders. We also establish a monotone property of Wyner´s common information which is in contrast to other notions of the common information, specifically Shannon´s mutual information and Gács and Körner´s common randomness. Examples about the computation of Wyner´s common information of N random variables are also given.
  • Keywords
    Gray codes; decoding; source coding; Gács common randomness; Gray-Wyner source coding network; Körners common randomness; N random variables; Shannons mutual information; Wyners common information; coding theorems; decoders; source sequences; Decoding; Generators; Joints; Mutual information; Program processors; Random variables; Source coding;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Communication, Control, and Computing (Allerton), 2010 48th Annual Allerton Conference on
  • Conference_Location
    Allerton, IL
  • Print_ISBN
    978-1-4244-8215-3
  • Type

    conf

  • DOI
    10.1109/ALLERTON.2010.5706995
  • Filename
    5706995