Title :
Empirical quantizer design in the presence of source noise or channel noise
Author :
Linder, Tamás ; Lugosi, Gábor ; Zeger, Kenneth
Author_Institution :
Dept. of Math. & Comput. Sci., Tech. Univ. Budapest, Hungary
fDate :
3/1/1997 12:00:00 AM
Abstract :
The problem of vector quantizer empirical design for noisy channels or for noisy sources is studied. It is shown that the average squared distortion of a vector quantizer designed optimally from observing clean independent and identically distributed (i.i.d.) training vectors converges in expectation, as the training set size grows, to the minimum possible mean-squared error obtainable for quantizing the clean source and transmitting across a discrete memoryless noisy channel. Similarly, it is shown that if the source is corrupted by additive noise, then the average squared distortion of a vector quantizer designed optimally from observing i.i.d. noisy training vectors converges in expectation, as the training set size grows, to the minimum possible mean-squared error obtainable for quantizing the noisy source and transmitting across a noiseless channel. Rates of convergence are also provided
Keywords :
channel coding; convergence of numerical methods; memoryless systems; noise; rate distortion theory; source coding; vector quantisation; additive noise; average squared distortion; channel noise; convergence rates; discrete memoryless noisy channel; empirical design; i.i.d. training vectors; independent and identically distributed training vectors; minimum possible mean-squared error; noiseless channel; source noise; vector quantizer; Additive noise; Algorithm design and analysis; Channel coding; Convergence; Gaussian noise; Iterative algorithms; Performance analysis; Quantization; Source coding; Statistics;
Journal_Title :
Information Theory, IEEE Transactions on