Title :
Coding combinatorial sources with costs
Author :
Suzuki, Joe ; Ryabko, Boris
Author_Institution :
Dept. of Math., Osaka Univ., Japan
fDate :
5/1/2004 12:00:00 AM
Abstract :
We consider coding infinite sequences of a finite alphabet. The source is defined as a set of sequences (combinatorial source). The problem is to minimize the worst asymptotic compression ratio between each sequence and its coding output among the sequences in the combinatorial source. Ryabko showed that the optimal value coincides with the Hausdorff dimension of the combinatorial source. This correspondence extends the previous work in that the input and output costs are expressed in terms of not lengths but generalized costs. The essential quantity turns out to be the Hausdorff dimension with respect to the measure associated with the input cost. We construct an asymptotically optimal coding procedure, and also show that no coding scheme can beat the lower bound.
Keywords :
combinatorial mathematics; sequences; source coding; Cajar´s formula; Hausdorff dimension; asymptotically optimal coding procedure; combinatorial sources coding; Concatenated codes; Cost function; Information theory; Mathematics; Source coding; Springs;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2004.826653