Title :
Capacity of channels with uncoded-message side-information
Author :
Shamai, Shlomo ; Verdú, Sergio
Author_Institution :
Dept. of Electr. Eng., Technion-Israel Inst. of Technol., Haifa, Israel
Abstract :
Parallel independent channels where no encoding is allowed for one of the channels are studied. The Slepian-Wolf theorem on source coding of correlated sources is used to show that any information source whose entropy rate is below the sum of the capacity of the coded channel and the input/output mutual information of the uncoded channel is transmissible with arbitrary reliability. The converse is also shown. Thus, coding of the side information channel is unnecessary when its mutual information is maximized by the source distribution. An information-theoretic interpretation of parallel-concatenated channel codes and, in particular, turbo codes is put forth
Keywords :
channel capacity; channel coding; concatenated codes; entropy; source coding; Slepian-Wolf theorem; channel capacity; correlated sources; entropy rate; information source; information-theoretic interpretation; input/output mutual information; parallel independent channels; parallel-concatenated channel codes; reliability; source coding; source distribution; turbo codes; uncoded channel; uncoded-message side-information; Channel capacity; Channel coding; Concatenated codes; Entropy; Linear code; Memoryless systems; Mutual information; Reliability theory; Source coding; Turbo codes;
Conference_Titel :
Information Theory, 1995. Proceedings., 1995 IEEE International Symposium on
Conference_Location :
Whistler, BC
Print_ISBN :
0-7803-2453-6
DOI :
10.1109/ISIT.1995.531109