• DocumentCode
    1502084
  • Title

    Fast universal coding with context models

  • Author

    Rissanen, Jorma

  • Author_Institution
    IBM Almaden Res. Center, San Jose, CA, USA
  • Volume
    45
  • Issue
    4
  • fYear
    1999
  • fDate
    5/1/1999 12:00:00 AM
  • Firstpage
    1065
  • Lastpage
    1071
  • Abstract
    A universal code using context models is constructed, which is optimal in the strong sense that the mean per symbol code length approaches asymptotically the entropy of any data generating tree machine at the fastest possible rate. The number of coding operations required is O (n log log n) for a string of length n, which is much less than in the earlier codes using context models. This is made possible by two new results. The first is a theorem stating that the updates required for universality need be done only once for each batch, the length of which grows at nearly exponential rate in the number of batches. The second is a fast implementation of the tree-building part in algorithm context
  • Keywords
    binary codes; computational complexity; entropy; trees (mathematics); algorithm context; binary process; context models; data generating tree machine; entropy; exponential growth rate; fast universal coding; mean per symbol code length; theorem; universal code; updates; Arithmetic; Context modeling; Cost function; Decoding; Encoding; Entropy; Helium; Markov processes; Source coding; Table lookup;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.761250
  • Filename
    761250