Title :
The Kolmogorov complexity, universal distribution, and coding theorem for generalized length functions
Author :
Kobayashi, Kojiro
Author_Institution :
Dept. of Math. & Comput. Sci., Tokyo Inst. of Technol., Japan
fDate :
5/1/1997 12:00:00 AM
Abstract :
A function h(w) is said to be useful for the coding theorem if the coding theorem remains to be true when the lengths |w| of codewords w in it are replaced with h(w). For a codeword w=a0a1...am-1 of length m and an infinite sequence Q=(q0, q1, q2, ...) of real numbers such that 0<qn⩽½, let |w|Q denote the value Σn=0m-1 (if an =0 then -log2qn, else -log2(1-q n)), that is, -log2, (the probability that flippings of coins generate x) assuming that the (i+1)th coin generates a tail (or 0) with probability qi. It is known that if 0<lim infn→∞ qn then |w|Q is useful for the coding theorem and if limn→∞ q n/(1/(2n))=0 then |w|Q is not useful. We introduce several variations of the coding theorem and show sufficient conditions for h(w) not to be useful for these variations. The usefulness is also defined for the expressions that define the Kolmogorov complexity and the universal distribution. We consider the relation among the usefulness for the coding theorem, that for the Kolmogorov complexity, and that for the universal distribution
Keywords :
computational complexity; encoding; functions; sequences; statistical analysis; Kolmogorov complexity; codewords; coding theorem; coin flipping; generalized length functions; infinite sequence; probability; real numbers; sufficient conditions; universal distribution; Codes; Costs; Sufficient conditions; Tail;
Journal_Title :
Information Theory, IEEE Transactions on