• DocumentCode
    2521300
  • Title

    Enumerative coding for tree sources

  • Author

    Martin, Andrew ; Seroussi, Gadiel ; Weinberger, Marcelo

  • Author_Institution
    Univ. de la Republica, Montevideo
  • fYear
    2008
  • fDate
    6-11 July 2008
  • Firstpage
    2459
  • Lastpage
    2463
  • Abstract
    Efficient enumerative coding for tree sources is, in general, surprisingly intricate-a simple uniform encoding of type classes, which is asymptotically optimal in expectation for many classical models such as FSMs, turns out not to be so in this case. We describe an efficiently computable enumerative code that is universal in the class of tree sources in the sense that, for a string emitted by an unknown source supported on a known tree, the expected normalized code length approaches the entropy rate of the source with a convergence rate (K/2)(log n)/n, where K is the number of free parameters of the source. The results extend also to the twice-universal setting, where the tree is unknown.
  • Keywords
    entropy; source coding; trees (mathematics); variable length codes; entropy rate; enumerative coding; normalized code length; tree sources; Convergence; Data compression; Encoding; Entropy; Information theory; Laboratories; Maximum likelihood decoding; Parametric statistics; State estimation; Yield estimation;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory, 2008. ISIT 2008. IEEE International Symposium on
  • Conference_Location
    Toronto, ON
  • Print_ISBN
    978-1-4244-2256-2
  • Electronic_ISBN
    978-1-4244-2257-9
  • Type

    conf

  • DOI
    10.1109/ISIT.2008.4595433
  • Filename
    4595433