• DocumentCode
    915382
  • Title

    Rate distortion functions for finite-state finite-alphabet Markov sources

  • Author

    Gray, Robert M.

  • Volume
    17
  • Issue
    2
  • fYear
    1971
  • fDate
    3/1/1971 12:00:00 AM
  • Firstpage
    127
  • Lastpage
    134
  • Abstract
    A lower bound to the rate-distortion function R(D) of finite-alphabet sources with memory is derived for the class of balanced distortion measures. For finite-state finite-alphabet Markov sources, sufficient conditions are given for the existence of a strictly positive average distortion D_c such that R(D) equals its lower bound for 0 \\buildrel{<}\\over{=} D \\buildrel{<}\\over{=} D_c . The bound is evaluated for the Hamming and Lee distortion measures and is identical to the corresponding bound for memoryless sources having the same entropy and alphabet. These results are applied to yield a simple proof of the converse of the noisy-channel coding theorem for sources satisfying the sufficient conditions for equality with the lower bound and channels with memory. D_c is evaluated explicitly for the special case of the binary asymmetric Markov source.
  • Keywords
    Markov processes; Rate-distortion theory; Additives; Codes; Distortion measurement; Entropy; Hamming distance; Information theory; Rate-distortion; Size measurement; Statistics; Sufficient conditions;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.1971.1054604
  • Filename
    1054604