Title :
Fast universal coding with context models
Author_Institution :
IBM Almaden Res. Center, San Jose, CA, USA
fDate :
5/1/1999 12:00:00 AM
Abstract :
A universal code using context models is constructed, which is optimal in the strong sense that the mean per symbol code length approaches asymptotically the entropy of any data generating tree machine at the fastest possible rate. The number of coding operations required is O (n log log n) for a string of length n, which is much less than in the earlier codes using context models. This is made possible by two new results. The first is a theorem stating that the updates required for universality need be done only once for each batch, the length of which grows at nearly exponential rate in the number of batches. The second is a fast implementation of the tree-building part in algorithm context
Keywords :
binary codes; computational complexity; entropy; trees (mathematics); algorithm context; binary process; context models; data generating tree machine; entropy; exponential growth rate; fast universal coding; mean per symbol code length; theorem; universal code; updates; Arithmetic; Context modeling; Cost function; Decoding; Encoding; Entropy; Helium; Markov processes; Source coding; Table lookup;
Journal_Title :
Information Theory, IEEE Transactions on