DocumentCode
1502084
Title
Fast universal coding with context models
Author
Rissanen, Jorma
Author_Institution
IBM Almaden Res. Center, San Jose, CA, USA
Volume
45
Issue
4
fYear
1999
fDate
5/1/1999 12:00:00 AM
Firstpage
1065
Lastpage
1071
Abstract
A universal code using context models is constructed, which is optimal in the strong sense that the mean per symbol code length approaches asymptotically the entropy of any data generating tree machine at the fastest possible rate. The number of coding operations required is O (n log log n) for a string of length n, which is much less than in the earlier codes using context models. This is made possible by two new results. The first is a theorem stating that the updates required for universality need be done only once for each batch, the length of which grows at nearly exponential rate in the number of batches. The second is a fast implementation of the tree-building part in algorithm context
Keywords
binary codes; computational complexity; entropy; trees (mathematics); algorithm context; binary process; context models; data generating tree machine; entropy; exponential growth rate; fast universal coding; mean per symbol code length; theorem; universal code; updates; Arithmetic; Context modeling; Cost function; Decoding; Encoding; Entropy; Helium; Markov processes; Source coding; Table lookup;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/18.761250
Filename
761250
Link To Document