DocumentCode :
1443039
Title :
The redundancy of source coding with a fidelity criterion .II. Coding at a fixed rate level with unknown statistics
Author :
Yang, En-Hui ; Zhang, Zhen
Author_Institution :
Dept. of Electr. & Comput. Eng., Waterloo Univ., Ont., Canada
Volume :
47
Issue :
1
fYear :
2001
fDate :
1/1/2001 12:00:00 AM
Firstpage :
126
Lastpage :
145
Abstract :
The redundancy problem of universal lossy source coding at a fixed rate level is considered. Under some condition on the single-letter distortion measure, which implies that the cardinality K of the reproduction alphabet is not greater than the cardinality J of the source alphabet, it is shown that the redundancy of universally coding memoryless sources p by nth-order block codes of rate R goes like |(∂/∂R)d(p,R)|Kln n/2n+o(ln n/n) for all memoryless sources p except a set whose volume goes to 0 as the block length n goes to infinity, where d(p,R) denotes the distortion rate function of p. Specifically, for any sequence {Cn}n=1 of block codes, where Cn is an nth-order block code at the fixed rate R, and any ε>0, the redundancy Dn(C n,p) of Cn for p is greater than or equal to |(∂/∂R)d(p,R)|(K-ε)ln n/2n for all p satisfying some regular conditions except a set whose volume goes to 0 as n→∞. On the other hand, there exists a sequence {Cn}n=1 of block codes at the rate R such that for any p satisfying some regular conditions, the super limit of Dn(Cn,p)|(ln n/n) is less than or equal to |(∂/∂R)d(p,R)|K/2
Keywords :
block codes; memoryless systems; rate distortion theory; source coding; statistical analysis; block codes; block length; cardinality; code rate; distortion rate function; fidelity criterion; fixed rate coding; memoryless sources; regular conditions; reproduction alphabet; sequence; single-letter distortion measure; source alphabet; source coding redundancy; universal lossy source coding; unknown statistics; Block codes; Distortion measurement; H infinity control; Length measurement; Performance loss; Rate distortion theory; Rate-distortion; Source coding; Statistics; Volume measurement;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/18.904517
Filename :
904517
Link To Document :
بازگشت