Title :
On instantaneous codes for zero-error coding of two correlated sources
Author :
Yan, Ying-On ; Berger, Toby
Author_Institution :
Sch. of Electr. Eng., Cornell Univ., Ithaca, NY, USA
Abstract :
We study the problem of finding zero-error instantaneous codes for the Slepian-Wolf configuration. By a zero-error instantaneous code we mean two encoder maps f1:χ→{0,1}*, f2:Y→{0,1}* and a decoding algorithm which, for any pair of encoder outputs f1(x1)f1(x2 )f1(x3)... and f2(y1)f 2(y2)f2(y3)..., can correctly determine x1 and y1 by reading only the first length (f1(x1)) bits of the X encoder output and the first length (f2(y1)) bits of the Y encoder output. For |χ|=2, we find a necessary and sufficient condition for the existence of a zero-error instantaneous code with a given set of codeword lengths for Y. Using this condition, we derive an upper bound to the minimum expected codeword length for Y and construct a simple example showing that the coding scheme proposed by Kh, Jabri and Al-Issa (1997) is not optimal in general, and more surprisingly, the optimal code may violate the “Morse condition” that the more probable of two symbols never has the longer codeword. For |χ|=3, we find a necessary but not sufficient condition for the existence of a zero-error instantaneous code with a given set of codeword lengths for Y. Moreover, for |χ|⩾3, the existence of such a code is shown to be related to a rectangle packing problem
Keywords :
Huffman codes; correlation theory; decoding; source coding; Huffman code; Morse condition; Slepian-Wolf configuration; correlated sources; decoding algorithm; encoder maps; instantaneous codes; minimum expected codeword length; rectangle packing problem; zero-error coding; Decoding; Entropy; Sufficient conditions; Upper bound;
Conference_Titel :
Information Theory, 2000. Proceedings. IEEE International Symposium on
Conference_Location :
Sorrento
Print_ISBN :
0-7803-5857-0
DOI :
10.1109/ISIT.2000.866642