DocumentCode
640222
Title
Average redundancy of the Shannon code for Markov sources
Author
Merhav, Neri ; Szpankowski, Wojciech
Author_Institution
Dept. of Electr. Eng., Technion - Israel Inst. of Technolgy, Haifa, Israel
fYear
2013
fDate
7-12 July 2013
Firstpage
1919
Lastpage
1923
Abstract
It is known that for memoryless sources, the average and maximal redundancy of fixed-to-variable length codes, such as the Shannon and Huffman codes, exhibit two modes of behavior for long blocks. It either converges to a limit or it has an oscillatory pattern, depending on the irrationality or rationality, respectively, of certain parameters that depend on the source. Here, we extend these findings for the Shannon code to the case of a Markov source, which is considerably more involved. We provide a precise characterization of the redundancy of the Shannon code redundancy for a class of irreducible, periodic and aperiodic Markov sources.
Keywords
Huffman codes; variable length codes; Huffman codes; Markov sources; Shannon codes; fixed-to-variable length codes; memoryless sources; Educational institutions; Eigenvalues and eigenfunctions; Indexes; Information theory; Markov processes; Redundancy; Vectors;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory Proceedings (ISIT), 2013 IEEE International Symposium on
Conference_Location
Istanbul
ISSN
2157-8095
Type
conf
DOI
10.1109/ISIT.2013.6620560
Filename
6620560
Link To Document