• DocumentCode
    1311547
  • Title

    Empirical quantizer design in the presence of source noise or channel noise

  • Author

    Linder, Tamás ; Lugosi, Gábor ; Zeger, Kenneth

  • Author_Institution
    Dept. of Math. & Comput. Sci., Tech. Univ. Budapest, Hungary
  • Volume
    43
  • Issue
    2
  • fYear
    1997
  • fDate
    3/1/1997 12:00:00 AM
  • Firstpage
    612
  • Lastpage
    623
  • Abstract
    The problem of vector quantizer empirical design for noisy channels or for noisy sources is studied. It is shown that the average squared distortion of a vector quantizer designed optimally from observing clean independent and identically distributed (i.i.d.) training vectors converges in expectation, as the training set size grows, to the minimum possible mean-squared error obtainable for quantizing the clean source and transmitting across a discrete memoryless noisy channel. Similarly, it is shown that if the source is corrupted by additive noise, then the average squared distortion of a vector quantizer designed optimally from observing i.i.d. noisy training vectors converges in expectation, as the training set size grows, to the minimum possible mean-squared error obtainable for quantizing the noisy source and transmitting across a noiseless channel. Rates of convergence are also provided
  • Keywords
    channel coding; convergence of numerical methods; memoryless systems; noise; rate distortion theory; source coding; vector quantisation; additive noise; average squared distortion; channel noise; convergence rates; discrete memoryless noisy channel; empirical design; i.i.d. training vectors; independent and identically distributed training vectors; minimum possible mean-squared error; noiseless channel; source noise; vector quantizer; Additive noise; Algorithm design and analysis; Channel coding; Convergence; Gaussian noise; Iterative algorithms; Performance analysis; Quantization; Source coding; Statistics;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.556117
  • Filename
    556117