DocumentCode
2768803
Title
Limit results on pattern entropy
Author
Orlitsky, A. ; Santhanam, N.P. ; Viswanathan, K. ; Zhang, J.
fYear
2004
fDate
24-29 Oct. 2004
Firstpage
99
Lastpage
104
Abstract
We determine the entropy rate of patterns of i.i.d. strings and show that they satisfy an asymptotic equipartition property. We prove that for discrete distributions the entropy rate of patterns equals that of the distribution, and that for distributions with continuous probability q, the entropy rate of patterns equals that of a modified distribution where the continuous probability is assigned to a new discrete element. One implication of these results is that for discrete distributions the conditional entropy rate of the sequence when its pattern is known is zero. We address only distributions with finite entropy.
Keywords
data compression; entropy; sequences; statistical distributions; asymptotic equipartition property; continuous probability; discrete distributions; entropy rate; i.i.d. strings; limit results; pattern entropy; sequence; universal compression; Entropy; H infinity control; Probability density function; Speech; Sufficient conditions;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory Workshop, 2004. IEEE
Print_ISBN
0-7803-8720-1
Type
conf
DOI
10.1109/ITW.2004.1405282
Filename
1405282
Link To Document