Title :
The common information of N dependent random variables
Author :
Liu, Wei ; Xu, Ge ; Chen, Biao
Author_Institution :
Dept. of EECS, Syracuse Univ., Syracuse, NY, USA
fDate :
Sept. 29 2010-Oct. 1 2010
Abstract :
This paper generalizes Wyner´s definition of common information of a pair of random variables to that of N random variables. We prove coding theorems that show the same operational meanings for the common information of two random variables generalize to that of N random variables. As a byproduct of our proof, we show that the Gray-Wyner source coding network can be generalized to N source sequences with N decoders. We also establish a monotone property of Wyner´s common information which is in contrast to other notions of the common information, specifically Shannon´s mutual information and Gács and Körner´s common randomness. Examples about the computation of Wyner´s common information of N random variables are also given.
Keywords :
Gray codes; decoding; source coding; Gács common randomness; Gray-Wyner source coding network; Körners common randomness; N random variables; Shannons mutual information; Wyners common information; coding theorems; decoders; source sequences; Decoding; Generators; Joints; Mutual information; Program processors; Random variables; Source coding;
Conference_Titel :
Communication, Control, and Computing (Allerton), 2010 48th Annual Allerton Conference on
Conference_Location :
Allerton, IL
Print_ISBN :
978-1-4244-8215-3
DOI :
10.1109/ALLERTON.2010.5706995