Title :
Average redundancy of the Shannon code for Markov sources
Author :
Merhav, Neri ; Szpankowski, Wojciech
Author_Institution :
Dept. of Electr. Eng., Technion - Israel Inst. of Technolgy, Haifa, Israel
Abstract :
It is known that for memoryless sources, the average and maximal redundancy of fixed-to-variable length codes, such as the Shannon and Huffman codes, exhibit two modes of behavior for long blocks. It either converges to a limit or it has an oscillatory pattern, depending on the irrationality or rationality, respectively, of certain parameters that depend on the source. Here, we extend these findings for the Shannon code to the case of a Markov source, which is considerably more involved. We provide a precise characterization of the redundancy of the Shannon code redundancy for a class of irreducible, periodic and aperiodic Markov sources.
Keywords :
Huffman codes; variable length codes; Huffman codes; Markov sources; Shannon codes; fixed-to-variable length codes; memoryless sources; Educational institutions; Eigenvalues and eigenfunctions; Indexes; Information theory; Markov processes; Redundancy; Vectors;
Conference_Titel :
Information Theory Proceedings (ISIT), 2013 IEEE International Symposium on
Conference_Location :
Istanbul
DOI :
10.1109/ISIT.2013.6620560