DocumentCode :
2768803
Title :
Limit results on pattern entropy
Author :
Orlitsky, A. ; Santhanam, N.P. ; Viswanathan, K. ; Zhang, J.
fYear :
2004
fDate :
24-29 Oct. 2004
Firstpage :
99
Lastpage :
104
Abstract :
We determine the entropy rate of patterns of i.i.d. strings and show that they satisfy an asymptotic equipartition property. We prove that for discrete distributions the entropy rate of patterns equals that of the distribution, and that for distributions with continuous probability q, the entropy rate of patterns equals that of a modified distribution where the continuous probability is assigned to a new discrete element. One implication of these results is that for discrete distributions the conditional entropy rate of the sequence when its pattern is known is zero. We address only distributions with finite entropy.
Keywords :
data compression; entropy; sequences; statistical distributions; asymptotic equipartition property; continuous probability; discrete distributions; entropy rate; i.i.d. strings; limit results; pattern entropy; sequence; universal compression; Entropy; H infinity control; Probability density function; Speech; Sufficient conditions;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Information Theory Workshop, 2004. IEEE
Print_ISBN :
0-7803-8720-1
Type :
conf
DOI :
10.1109/ITW.2004.1405282
Filename :
1405282
Link To Document :
بازگشت