DocumentCode
2521300
Title
Enumerative coding for tree sources
Author
Martin, Andrew ; Seroussi, Gadiel ; Weinberger, Marcelo
Author_Institution
Univ. de la Republica, Montevideo
fYear
2008
fDate
6-11 July 2008
Firstpage
2459
Lastpage
2463
Abstract
Efficient enumerative coding for tree sources is, in general, surprisingly intricate-a simple uniform encoding of type classes, which is asymptotically optimal in expectation for many classical models such as FSMs, turns out not to be so in this case. We describe an efficiently computable enumerative code that is universal in the class of tree sources in the sense that, for a string emitted by an unknown source supported on a known tree, the expected normalized code length approaches the entropy rate of the source with a convergence rate (K/2)(log n)/n, where K is the number of free parameters of the source. The results extend also to the twice-universal setting, where the tree is unknown.
Keywords
entropy; source coding; trees (mathematics); variable length codes; entropy rate; enumerative coding; normalized code length; tree sources; Convergence; Data compression; Encoding; Entropy; Information theory; Laboratories; Maximum likelihood decoding; Parametric statistics; State estimation; Yield estimation;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory, 2008. ISIT 2008. IEEE International Symposium on
Conference_Location
Toronto, ON
Print_ISBN
978-1-4244-2256-2
Electronic_ISBN
978-1-4244-2257-9
Type
conf
DOI
10.1109/ISIT.2008.4595433
Filename
4595433
Link To Document