Title :
On zero-error source coding with decoder side information
Author :
Koulgi, Prashant ; Tuncel, Ertem ; Regunathan, Shankar L. ; Rose, Kenneth
Author_Institution :
Dept. of Electr. & Comput. Eng., Univ. of California, Santa Barbara, CA, USA
fDate :
1/1/2003 12:00:00 AM
Abstract :
Let (X,Y) be a pair of random variables distributed over a finite product set V×W according to a probability distribution P(x,y). The following source coding problem is considered: the encoder knows X, while the decoder knows Y and wants to learn X without error. The minimum zero-error asymptotic rate of transmission is shown to be the complementary graph entropy of an associated graph. Thus, previous results in the literature provide upper and lower bounds for this minimum rate (further, these bounds are tight for the important class of perfect graphs). The algorithmic aspects of instantaneous code design are considered next. It is shown that optimal code design is NP-hard. An optimal code design algorithm is derived. Polynomial-time suboptimal algorithms are also presented, and their average and worst case performance guarantees are established.
Keywords :
computational complexity; decoding; entropy; random processes; source coding; NP-hard problem; average performance guarantee; complementary graph entropy; decoder; decoder side information; finite product set; instantaneous code design; lower bounds; minimum zero-error asymptotic transmission rate; optimal code design algorithm; polynomial-time suboptimal algorithms; probability distribution; random variables; upper bounds; worst case performance guarantee; zero-error source coding; Algorithm design and analysis; Decoding; Entropy; Helium; Information theory; Materials science and technology; Polynomials; Probability distribution; Random variables; Source coding;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2002.806154