• DocumentCode
    1525111
  • Title

    Operational Duality Between Lossy Compression and Channel Coding

  • Author

    Gupta, Ankit ; VerdÙ, Sergio

  • Author_Institution
    Samsung Telecommun. America, Richardson, TX, USA
  • Volume
    57
  • Issue
    6
  • fYear
    2011
  • fDate
    6/1/2011 12:00:00 AM
  • Firstpage
    3171
  • Lastpage
    3179
  • Abstract
    We explore the duality between lossy compression and channel coding in the operational sense: whether a capacity-achieving encoder-decoder sequence achieves the rate-distortion function of the dual problem when the channel decoder [encoder] is the source compressor [decompressor, resp.], and vice versa. We show that, if used as a lossy compressor, the maximum-likelihood channel decoder of a randomly chosen capacity-achieving codebook achieves the rate-distortion function almost surely. However, operational duality does not hold for every capacity achieving encoder-decoder sequence, or rate-distortion achieving compressor-decompressor sequence. We show that there exist optimal channel coding [lossy compression] schemes, which fail when used for the dual lossy compression [channel coding resp.] problem.
  • Keywords
    channel coding; maximum likelihood decoding; rate distortion theory; capacity-achieving encoder-decoder sequence; channel coding; lossy compression; maximum-likelihood channel decoder; operational duality; rate-distortion function; Channel coding; Cost function; Maximum likelihood decoding; Memoryless systems; Rate-distortion; Channel coding with cost constraints; discrete memoryless channels; discrete memoryless sources; lossy data compression; rate-distortion theory; source-channel coding duality;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2011.2136910
  • Filename
    5773027