• DocumentCode
    640222
  • Title

    Average redundancy of the Shannon code for Markov sources

  • Author

    Merhav, Neri ; Szpankowski, Wojciech

  • Author_Institution
    Dept. of Electr. Eng., Technion - Israel Inst. of Technolgy, Haifa, Israel
  • fYear
    2013
  • fDate
    7-12 July 2013
  • Firstpage
    1919
  • Lastpage
    1923
  • Abstract
    It is known that for memoryless sources, the average and maximal redundancy of fixed-to-variable length codes, such as the Shannon and Huffman codes, exhibit two modes of behavior for long blocks. It either converges to a limit or it has an oscillatory pattern, depending on the irrationality or rationality, respectively, of certain parameters that depend on the source. Here, we extend these findings for the Shannon code to the case of a Markov source, which is considerably more involved. We provide a precise characterization of the redundancy of the Shannon code redundancy for a class of irreducible, periodic and aperiodic Markov sources.
  • Keywords
    Huffman codes; variable length codes; Huffman codes; Markov sources; Shannon codes; fixed-to-variable length codes; memoryless sources; Educational institutions; Eigenvalues and eigenfunctions; Indexes; Information theory; Markov processes; Redundancy; Vectors;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory Proceedings (ISIT), 2013 IEEE International Symposium on
  • Conference_Location
    Istanbul
  • ISSN
    2157-8095
  • Type

    conf

  • DOI
    10.1109/ISIT.2013.6620560
  • Filename
    6620560