• DocumentCode
    1203479
  • Title

    Asymptotic redundancy of the MTF scheme for stationary ergodic sources

  • Author

    Arimura, Mitsuharu ; Yamamoto, Hirosuke

  • Author_Institution
    Dept. of Syst. & Commun. Eng., Shonan Inst. of Technol., Kanagawa, Japan
  • Volume
    51
  • Issue
    11
  • fYear
    2005
  • Firstpage
    3742
  • Lastpage
    3752
  • Abstract
    The Move-to-front (MTF) scheme is a data-compression method which converts each symbol of a source sequence to a positive integer sequentially, and encodes it to a binary codeword. The compression performance of this algorithm has been analyzed usually under the assumption of the so-called symbol extension. But, in this paper, upper and lower bounds are derived for the redundancy of the MTF scheme without the symbol extension for stationary ergodic sources and Markov sources. It is also proved that for the stationary ergodic first-order Markov sources, the MTF scheme can attain the entropy rate if and only if the transition matrix of the source is a kind of doubly stochastic matrix. Moreover, if the source is a Kth-order Markov source (K≥2), the MTF scheme cannot attain the entropy rate of the source generally.
  • Keywords
    Markov processes; data compression; entropy codes; matrix algebra; redundancy; sequential codes; source coding; MTF; MTF scheme; asymptotic redundancy; binary codeword; data-compression method; doubly stochastic matrix; entropy rate; first-order Markov source; move-to-front scheme; sequential positive integer; stationary ergodic source sequence; symbol extension; transition matrix; Algorithm design and analysis; Entropy; Helium; Information analysis; Information theory; Performance analysis; Source coding; Stochastic processes; Systems engineering and theory; Upper bound; Asymptotic redundancy; Markov sources; doubly stochastic process; move-to-front (MTF) scheme; stationary ergodic sources;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2005.856941
  • Filename
    1522637