DocumentCode
2421841
Title
The common information of N dependent random variables
Author
Liu, Wei ; Xu, Ge ; Chen, Biao
Author_Institution
Dept. of EECS, Syracuse Univ., Syracuse, NY, USA
fYear
2010
fDate
Sept. 29 2010-Oct. 1 2010
Firstpage
836
Lastpage
843
Abstract
This paper generalizes Wyner´s definition of common information of a pair of random variables to that of N random variables. We prove coding theorems that show the same operational meanings for the common information of two random variables generalize to that of N random variables. As a byproduct of our proof, we show that the Gray-Wyner source coding network can be generalized to N source sequences with N decoders. We also establish a monotone property of Wyner´s common information which is in contrast to other notions of the common information, specifically Shannon´s mutual information and Gács and Körner´s common randomness. Examples about the computation of Wyner´s common information of N random variables are also given.
Keywords
Gray codes; decoding; source coding; Gács common randomness; Gray-Wyner source coding network; Körners common randomness; N random variables; Shannons mutual information; Wyners common information; coding theorems; decoders; source sequences; Decoding; Generators; Joints; Mutual information; Program processors; Random variables; Source coding;
fLanguage
English
Publisher
ieee
Conference_Titel
Communication, Control, and Computing (Allerton), 2010 48th Annual Allerton Conference on
Conference_Location
Allerton, IL
Print_ISBN
978-1-4244-8215-3
Type
conf
DOI
10.1109/ALLERTON.2010.5706995
Filename
5706995
Link To Document