DocumentCode :
2423044
Title :
Arimoto channel coding converse and Rényi divergence
Author :
Polyanskiy, Yury ; Verdu, Sergio
Author_Institution :
Dept. of Electr. Eng., Princeton Univ., Princeton, NJ, USA
fYear :
2010
fDate :
Sept. 29 2010-Oct. 1 2010
Firstpage :
1327
Lastpage :
1333
Abstract :
Arimoto proved a non-asymptotic upper bound on the probability of successful decoding achievable by any code on a given discrete memoryless channel. In this paper we present a simple derivation of the Arimoto converse based on the data-processing inequality for Rényi divergence. The method has two benefits. First, it generalizes to codes with feedback and gives the simplest proof of the strong converse for the DMC with feedback. Second, it demonstrates that the sphere-packing bound is strictly tighter than Arimoto converse for all channels, blocklengths and rates, since in fact we derive the latter from the former. Finally, we prove similar results for other (non-Rényi) divergence measures.
Keywords :
channel coding; decoding; memoryless systems; Arimoto channel coding converse; Renyi divergence; blocklength; data-processing inequality; decoding probability; discrete memoryless channel; nonasymptotic upper bound; sphere-packing bound; Atmospheric measurements; Channel estimation; Decoding; Entropy; Markov processes; Memoryless systems; Random variables; Rényi divergence; Shannon theory; feedback; information measures; strong converse;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Communication, Control, and Computing (Allerton), 2010 48th Annual Allerton Conference on
Conference_Location :
Allerton, IL
Print_ISBN :
978-1-4244-8215-3
Type :
conf
DOI :
10.1109/ALLERTON.2010.5707067
Filename :
5707067
Link To Document :
بازگشت