Title :
Kolmogorov´s structure function for probability models
Author_Institution :
Helsinki Inst. for Inf. Technol., Finland
Abstract :
This work was inspired by the paper of Vereshchagin and Vitanyi, where Kolmogorov´s unpublished work on his structure function and the associated minimal sufficient statistics decomposition in the algorithmic theory of information is studied. The extension of Kolmogorov´s great ideas to probability model classes turns out to add a new chapter to the MDL theory, which also provides an alternative approach to Shannon´s rate-distortion theory.
Keywords :
data compression; information theory; probability; statistical analysis; Kolmogorov´s structure function; MDL theory; algorithmic theory; associated minimal sufficient statistics decomposition; information theory; lossy data compression; noise distortion; probability models; Computer languages; Density functional theory; Educational institutions; Ellipsoids; Information technology; Parametric statistics; Probability; Stochastic processes; Upper bound;
Conference_Titel :
Information Theory Workshop, 2002. Proceedings of the 2002 IEEE
Print_ISBN :
0-7803-7629-3
DOI :
10.1109/ITW.2002.1115426