Distortion-rate models for entropy-coded lattice vector quantization

The increasing demand for real-time applications requires the use of variable-rate quantizers having good performance in the low bit rate domain. In order to minimize the complexity of quantization, as well as maintaining a reasonably high PSNR ratio, we propose to use an entropy-coded lattice vector quantizer (ECLVQ). These quantizers have proven to outperform the wellknown EZW algorithm’s performance in terms of rate-distortion tradeoff. In this paper, we focus our attention on the modeling of the mean squared error (mse) distortion and the prefix code rate for ECLVQ. First, we generalize the distortion model of Jeong and Gibson on fixed-rate cubic quantizers to lattices under a high rate assumption. Second, we derive new rate models for ECLVQ, efficient at low bit rates without any high rate assumptions. Simulation results prove the precision of our models.