• DocumentCode
    838791
  • Title

    Asymptotically Sufficient Partitions and Quantizations

  • Author

    Liese, Friedrich ; Morales, Domingo ; Vajda, Igor

  • Author_Institution
    Dept. of Math., Rostock Univ.
  • Volume
    52
  • Issue
    12
  • fYear
    2006
  • Firstpage
    5599
  • Lastpage
    5606
  • Abstract
    We consider quantizations of observations represented by finite partitions of observation spaces. Partitions usually decrease the sensitivity of observations to their probability distributions. A sequence of quantizations is considered to be asymptotically sufficient for a statistical problem if the loss of sensitivity is asymptotically negligible. The sensitivity is measured by f-divergences of distributions or the closely related f-informations including the classical Shannon information. It is demonstrated that in some cases the maximization of f-divergences means the same as minimization of distortion of observations in the classical sense considered in mathematical statistics and information theory. The main result of the correspondence is a general sufficient condition for the asymptotic sufficiency of quantizations. Selected applications of this condition are studied leading to new simple criteria of asymptotic optimality for quantizations of vector-valued observations and observations on general Poisson processes
  • Keywords
    statistical distributions; stochastic processes; vector quantisation; asymptotical sufficient partitions; general Poisson processes; probability distributions; quantization; Distortion measurement; Entropy; Image coding; Information rates; Information theory; Probability distribution; Quantization; Signal generators; Statistical distributions; Sufficient conditions; $f$-divergences; $f$-informations; Abstract observation spaces; Euclidean observation spaces; asymptotically sufficient partitions; asymptotically sufficient quantizations; general Poisson processes; optimal quantizations; sufficient statistics;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2006.885495
  • Filename
    4016305