DocumentCode
838791
Title
Asymptotically Sufficient Partitions and Quantizations
Author
Liese, Friedrich ; Morales, Domingo ; Vajda, Igor
Author_Institution
Dept. of Math., Rostock Univ.
Volume
52
Issue
12
fYear
2006
Firstpage
5599
Lastpage
5606
Abstract
We consider quantizations of observations represented by finite partitions of observation spaces. Partitions usually decrease the sensitivity of observations to their probability distributions. A sequence of quantizations is considered to be asymptotically sufficient for a statistical problem if the loss of sensitivity is asymptotically negligible. The sensitivity is measured by f-divergences of distributions or the closely related f-informations including the classical Shannon information. It is demonstrated that in some cases the maximization of f-divergences means the same as minimization of distortion of observations in the classical sense considered in mathematical statistics and information theory. The main result of the correspondence is a general sufficient condition for the asymptotic sufficiency of quantizations. Selected applications of this condition are studied leading to new simple criteria of asymptotic optimality for quantizations of vector-valued observations and observations on general Poisson processes
Keywords
statistical distributions; stochastic processes; vector quantisation; asymptotical sufficient partitions; general Poisson processes; probability distributions; quantization; Distortion measurement; Entropy; Image coding; Information rates; Information theory; Probability distribution; Quantization; Signal generators; Statistical distributions; Sufficient conditions; $f$ -divergences; $f$ -informations; Abstract observation spaces; Euclidean observation spaces; asymptotically sufficient partitions; asymptotically sufficient quantizations; general Poisson processes; optimal quantizations; sufficient statistics;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.2006.885495
Filename
4016305
Link To Document