Title :
Distortion program-size complexity with respect to a fidelity criterion and rate-distortion function
Author :
Yang, En-Hui ; Shen, Shi-Yi
Author_Institution :
Dept. of Math., Nankai Univ., Tianjin, China
fDate :
1/1/1993 12:00:00 AM
Abstract :
A novel concept of distortion Kolmogorov-chaitin complexity is proposed. Bearing analogy to ordinary Kolmogorov-Chaitin complexity that represents the information content of a single message, distortion Kolmogorov-Chaitin complexity can be regarded as the amount of information about a single message that must be conveyed in order to reproduce it with a bounded distortion. This explanation is justified by the properties of distortion Kolmogorov-Chaitin complexity and the equivalences between distortion Kolmogorov-Chaitin complexity and the rate-distortion function, which are analogous to those between ordinary Kolmogorov-Chaitin complexity and the Shannon entropy. Some implications for universal almost sure data compression are also discussed
Keywords :
communication complexity; data compression; information theory; bounded distortion; distortion Kolmogorov-chaitin complexity; fidelity criterion; information content; rate-distortion function; single message; universal almost sure data compression; Brownian motion; Data compression; Entropy; Least squares approximation; Noise measurement; Nonlinear distortion; Nonlinear systems; Rate-distortion; State estimation; Technological innovation;
Journal_Title :
Information Theory, IEEE Transactions on