Title :
Duality between channel capacity and rate distortion with two-sided state information
Author :
Cover, Thomas M. ; Chiang, Mung
Author_Institution :
Dept. of Electr. Eng., Stanford Univ., CA, USA
fDate :
6/1/2002 12:00:00 AM
Abstract :
We show that the duality between channel capacity and data compression is retained when state information is available to the sender, to the receiver, to both, or to neither. We present a unified theory for eight special cases of channel capacity and rate distortion with state information, which also extends existing results to arbitrary pairs of independent and identically distributed (i.i.d.) correlated state information (S1, S2) available at the sender and at the receiver, respectively. In particular, the resulting general formula for channel capacity C = maxp(u,x|s1) [I(U; S2, Y) I(U; S1)] assumes the same form as the generalized Wyner-Ziv (1976) rate distortion function R(D) = minp(u|x, s1)p(x&capped;|u, s2) [I(U; S 1, X) 1(U; S2)]
Keywords :
channel capacity; correlation methods; data compression; rate distortion theory; Shannon theory; channel capacity; correlated state information; data compression; generalized Wyner-Ziv rate distortion function; independent identical distribution; rate distortion; receiver; two-sided state information; Channel capacity; Cost function; Data communication; Data compression; Decoding; HDTV; Information theory; Rate-distortion; TV; Writing;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2002.1003843