DocumentCode :
1424617
Title :
The Kolmogorov complexity, universal distribution, and coding theorem for generalized length functions
Author :
Kobayashi, Kojiro
Author_Institution :
Dept. of Math. & Comput. Sci., Tokyo Inst. of Technol., Japan
Volume :
43
Issue :
3
fYear :
1997
fDate :
5/1/1997 12:00:00 AM
Firstpage :
816
Lastpage :
826
Abstract :
A function h(w) is said to be useful for the coding theorem if the coding theorem remains to be true when the lengths |w| of codewords w in it are replaced with h(w). For a codeword w=a0a1...am-1 of length m and an infinite sequence Q=(q0, q1, q2, ...) of real numbers such that 0<qn⩽½, let |w|Q denote the value Σn=0m-1 (if an =0 then -log2qn, else -log2(1-q n)), that is, -log2, (the probability that flippings of coins generate x) assuming that the (i+1)th coin generates a tail (or 0) with probability qi. It is known that if 0<lim infn→∞ qn then |w|Q is useful for the coding theorem and if limn→∞ q n/(1/(2n))=0 then |w|Q is not useful. We introduce several variations of the coding theorem and show sufficient conditions for h(w) not to be useful for these variations. The usefulness is also defined for the expressions that define the Kolmogorov complexity and the universal distribution. We consider the relation among the usefulness for the coding theorem, that for the Kolmogorov complexity, and that for the universal distribution
Keywords :
computational complexity; encoding; functions; sequences; statistical analysis; Kolmogorov complexity; codewords; coding theorem; coin flipping; generalized length functions; infinite sequence; probability; real numbers; sufficient conditions; universal distribution; Codes; Costs; Sufficient conditions; Tail;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/18.568693
Filename :
568693
Link To Document :
بازگشت