Title : 
Operational Duality Between Lossy Compression and Channel Coding
         
        
            Author : 
Gupta, Ankit ; VerdÙ, Sergio
         
        
            Author_Institution : 
Samsung Telecommun. America, Richardson, TX, USA
         
        
        
        
        
            fDate : 
6/1/2011 12:00:00 AM
         
        
        
        
            Abstract : 
We explore the duality between lossy compression and channel coding in the operational sense: whether a capacity-achieving encoder-decoder sequence achieves the rate-distortion function of the dual problem when the channel decoder [encoder] is the source compressor [decompressor, resp.], and vice versa. We show that, if used as a lossy compressor, the maximum-likelihood channel decoder of a randomly chosen capacity-achieving codebook achieves the rate-distortion function almost surely. However, operational duality does not hold for every capacity achieving encoder-decoder sequence, or rate-distortion achieving compressor-decompressor sequence. We show that there exist optimal channel coding [lossy compression] schemes, which fail when used for the dual lossy compression [channel coding resp.] problem.
         
        
            Keywords : 
channel coding; maximum likelihood decoding; rate distortion theory; capacity-achieving encoder-decoder sequence; channel coding; lossy compression; maximum-likelihood channel decoder; operational duality; rate-distortion function; Channel coding; Cost function; Maximum likelihood decoding; Memoryless systems; Rate-distortion; Channel coding with cost constraints; discrete memoryless channels; discrete memoryless sources; lossy data compression; rate-distortion theory; source-channel coding duality;
         
        
        
            Journal_Title : 
Information Theory, IEEE Transactions on
         
        
        
        
        
            DOI : 
10.1109/TIT.2011.2136910