Title :
Optimal entropy-constrained scalar quantization of a uniform source
Author :
György, András ; Linder, Tamás
Author_Institution :
Dept. of Math. & Stat., Queen´´s Univ., Kingston, Ont., Canada
fDate :
11/1/2000 12:00:00 AM
Abstract :
Optimal scalar quantization subject to an entropy constraint is studied for a wide class of difference distortion measures including rth-power distortions with r>0. It is proved that if the source is uniformly distributed over an interval, then for any entropy constraint R (in nats), an optimal quantizer has N=[eR] interval cells such that N-1 cells have equal length d and one cell has length c⩽d. The cell lengths are uniquely determined by the requirement that the entropy constraint is satisfied with equality. Based on this result, a parametric representation of the minimum achievable distortion Dh (R) as a function of the entropy constraint R is obtained for a uniform source. The Dh(R) curve turns out to be nonconvex in general. Moreover, for the squared-error distortion it is shown that D h(R) is a piecewise-concave function, and that a scalar quantizer achieving the lower convex hull of Dh(R) exists only at rates R=log N, where N is a positive integer
Keywords :
entropy codes; rate distortion theory; source coding; variable length codes; cell lengths; difference distortion measures; entropy constraint; equality; minimum achievable distortion; nonconvex curve; optimal entropy-constrained scalar quantization; optimal quantizer; optimal scalar quantization; parametric representation; piecewise-concave function; rth-power distortions; squared-error distortion; uniform source; Decoding; Distortion measurement; Information rates; Information theory; Linear predictive coding; Mutual information; Rate distortion theory; Rate-distortion; Source coding; Vector quantization;
Journal_Title :
Information Theory, IEEE Transactions on