Author_Institution :
Dept. of Electr. & Comput. Eng., Waterloo Univ., Ont., Canada
Abstract :
The redundancy problem of universal lossy source coding at a fixed rate level is considered. Under some condition on the single-letter distortion measure, which implies that the cardinality K of the reproduction alphabet is not greater than the cardinality J of the source alphabet, it is shown that the redundancy of universally coding memoryless sources p by nth-order block codes of rate R goes like |(∂/∂R)d(p,R)|Kln n/2n+o(ln n/n) for all memoryless sources p except a set whose volume goes to 0 as the block length n goes to infinity, where d(p,R) denotes the distortion rate function of p. Specifically, for any sequence {Cn}n=1∞ of block codes, where Cn is an nth-order block code at the fixed rate R, and any ε>0, the redundancy Dn(C n,p) of Cn for p is greater than or equal to |(∂/∂R)d(p,R)|(K-ε)ln n/2n for all p satisfying some regular conditions except a set whose volume goes to 0 as n→∞. On the other hand, there exists a sequence {Cn}n=1∞ of block codes at the rate R such that for any p satisfying some regular conditions, the super limit of Dn(Cn,p)|(ln n/n) is less than or equal to |(∂/∂R)d(p,R)|K/2
Keywords :
block codes; memoryless systems; rate distortion theory; source coding; statistical analysis; block codes; block length; cardinality; code rate; distortion rate function; fidelity criterion; fixed rate coding; memoryless sources; regular conditions; reproduction alphabet; sequence; single-letter distortion measure; source alphabet; source coding redundancy; universal lossy source coding; unknown statistics; Block codes; Distortion measurement; H infinity control; Length measurement; Performance loss; Rate distortion theory; Rate-distortion; Source coding; Statistics; Volume measurement;