Title :
Coding theorems on the worst-case redundancy of fixed-length coding for a general source
Author :
Koga, Hiroki ; Arimura, Mitsuharu ; Iwata, Ken-ichi
Author_Institution :
Grad. Sch. of Syst. & Inf. Eng., Univ. of Tsukuba, Tsukuba, Japan
fDate :
July 31 2011-Aug. 5 2011
Abstract :
We consider a situation where n-tuples generated from a general source are encoded by a fixed-length code and discuss coding theorems on the worst-case redundancy, where the worst-case redundancy is defined as the maximum of the difference between the rate and the ideal codeword length per symbol with respect to all the correctly decodable n-tuples. We treat the four cases where the decoding error probability εn is required to satisfy (a) limn→∞ εn = 0, (b) lim infn→∞ εn = 0, (c) lim supn→∞ εn ≤ ε, and (d) lim infn→∞ εn ≤ ε, respectively, where ε ∈ [0; 1) is an arbitrary constant. We give general formulas of the optimum worst-case redundancy that are closely related to the width of the entropy-spectrum of a source.
Keywords :
decoding; entropy codes; error statistics; source coding; arbitrary constant; coding theorem; decodable n-tuple; decoding error probability; entropy-spectrum source; fixed-length coding; general source coding; ideal codeword length per symbol; optimum worst-case redundancy; Channel coding; Decoding; Error probability; Manganese; Redundancy; Source coding;
Conference_Titel :
Information Theory Proceedings (ISIT), 2011 IEEE International Symposium on
Conference_Location :
St. Petersburg
Print_ISBN :
978-1-4577-0596-0
Electronic_ISBN :
2157-8095
DOI :
10.1109/ISIT.2011.6033753