DocumentCode :
1192567
Title :
Duality between source coding and channel coding and its extension to the side information case
Author :
Pradhan, S. Sandeep ; Chou, Jim ; Ramchandran, Kannan
Author_Institution :
Electr. Eng. & Comput. Sci. Dept., Univ. of Michigan, Ann Arbor, MI, USA
Volume :
49
Issue :
5
fYear :
2003
fDate :
5/1/2003 12:00:00 AM
Firstpage :
1181
Lastpage :
1203
Abstract :
We explore the information-theoretic duality between source coding with side information at the decoder and channel coding with side information at the encoder. We begin with a mathematical characterization of the functional duality between classical source and channel coding, formulating the precise conditions under which the optimal encoder for one problem is functionally identical to the optimal decoder for the other problem. We then extend this functional duality to the case of coding with side information. By invoking this duality, we are able to generalize the result of Wyner and Ziv (1976) relating to no rate loss for source coding with side information from Gaussian to more arbitrary distributions. We consider several examples corresponding to both discrete- and continuous-valued cases to illustrate our formulation. For the Gaussian cases of coding with side information, we invoke geometric arguments to provide further insights into their duality. Our geometric treatment inspires the construction and dual use of practical coset codes for a large class of emerging applications for coding with side information, such as distributed sensor networks, watermarking, and information-hiding communication systems.
Keywords :
Gaussian distribution; channel coding; codes; data encapsulation; error statistics; optimisation; source coding; watermarking; Gaussian distribution; Gaussian source coding; channel coding; coset codes; distributed sensor networks; error probability; functional duality; geometric arguments; information-hiding communication systems; information-theoretic duality; optimal decoder; optimal encoder; side information; source coding; watermarking; Channel coding; Computer aided software engineering; Costs; Decoding; Distortion measurement; Information theory; Mutual information; Quantization; Sensor systems and applications; Source coding;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/TIT.2003.810622
Filename :
1197848
Link To Document :
بازگشت