DocumentCode
1203479
Title
Asymptotic redundancy of the MTF scheme for stationary ergodic sources
Author
Arimura, Mitsuharu ; Yamamoto, Hirosuke
Author_Institution
Dept. of Syst. & Commun. Eng., Shonan Inst. of Technol., Kanagawa, Japan
Volume
51
Issue
11
fYear
2005
Firstpage
3742
Lastpage
3752
Abstract
The Move-to-front (MTF) scheme is a data-compression method which converts each symbol of a source sequence to a positive integer sequentially, and encodes it to a binary codeword. The compression performance of this algorithm has been analyzed usually under the assumption of the so-called symbol extension. But, in this paper, upper and lower bounds are derived for the redundancy of the MTF scheme without the symbol extension for stationary ergodic sources and Markov sources. It is also proved that for the stationary ergodic first-order Markov sources, the MTF scheme can attain the entropy rate if and only if the transition matrix of the source is a kind of doubly stochastic matrix. Moreover, if the source is a Kth-order Markov source (K≥2), the MTF scheme cannot attain the entropy rate of the source generally.
Keywords
Markov processes; data compression; entropy codes; matrix algebra; redundancy; sequential codes; source coding; MTF; MTF scheme; asymptotic redundancy; binary codeword; data-compression method; doubly stochastic matrix; entropy rate; first-order Markov source; move-to-front scheme; sequential positive integer; stationary ergodic source sequence; symbol extension; transition matrix; Algorithm design and analysis; Entropy; Helium; Information analysis; Information theory; Performance analysis; Source coding; Stochastic processes; Systems engineering and theory; Upper bound; Asymptotic redundancy; Markov sources; doubly stochastic process; move-to-front (MTF) scheme; stationary ergodic sources;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.2005.856941
Filename
1522637
Link To Document