• DocumentCode
    3383513
  • Title

    High rate mismatch in entropy constrained quantization

  • Author

    Gray, Robert M. ; Linder, Tamás

  • Author_Institution
    Dept. of Electr. Eng., Stanford Univ., CA, USA
  • fYear
    2003
  • fDate
    25-27 March 2003
  • Firstpage
    173
  • Lastpage
    182
  • Abstract
    It is shown that if an asymptotically optimal sequence of variable rate codes is designed for a k-dimensional probability density function (pdf) g and then applied to another pdf f for which f/g is bounded, then the resulting mismatch or loss of performance from the optimal possible is given by the relative entropy or Kullback-Leibler divergence I(f/spl par/g). It is also shown that under the same assumptions an asymptotically optimal code sequence for g can be converted to an asymptotically optimal code sequence for a mismatched source f by modifying only the lossless component of the code. The development does not require Gersho´s conjecture.
  • Keywords
    entropy; sequential codes; variable rate codes; vector quantisation; Kullback-Leibler divergence; asymptotically optimal quantization; entropy constrained quantization; high rate mismatch; high rate universal code; optical code sequence; pdf; probability density function; quantizer mismatch; relative entropy; variable rate code; Density measurement; Entropy; Information systems; Mathematics; Network address translation; Performance loss; Probability density function; Quantization; Rate-distortion; Statistics;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Data Compression Conference, 2003. Proceedings. DCC 2003
  • Conference_Location
    Snowbird, UT, USA
  • ISSN
    1068-0314
  • Print_ISBN
    0-7695-1896-6
  • Type

    conf

  • DOI
    10.1109/DCC.2003.1194008
  • Filename
    1194008