Title :
Arimoto channel coding converse and Rényi divergence
Author :
Polyanskiy, Yury ; Verdu, Sergio
Author_Institution :
Dept. of Electr. Eng., Princeton Univ., Princeton, NJ, USA
fDate :
Sept. 29 2010-Oct. 1 2010
Abstract :
Arimoto proved a non-asymptotic upper bound on the probability of successful decoding achievable by any code on a given discrete memoryless channel. In this paper we present a simple derivation of the Arimoto converse based on the data-processing inequality for Rényi divergence. The method has two benefits. First, it generalizes to codes with feedback and gives the simplest proof of the strong converse for the DMC with feedback. Second, it demonstrates that the sphere-packing bound is strictly tighter than Arimoto converse for all channels, blocklengths and rates, since in fact we derive the latter from the former. Finally, we prove similar results for other (non-Rényi) divergence measures.
Keywords :
channel coding; decoding; memoryless systems; Arimoto channel coding converse; Renyi divergence; blocklength; data-processing inequality; decoding probability; discrete memoryless channel; nonasymptotic upper bound; sphere-packing bound; Atmospheric measurements; Channel estimation; Decoding; Entropy; Markov processes; Memoryless systems; Random variables; Rényi divergence; Shannon theory; feedback; information measures; strong converse;
Conference_Titel :
Communication, Control, and Computing (Allerton), 2010 48th Annual Allerton Conference on
Conference_Location :
Allerton, IL
Print_ISBN :
978-1-4244-8215-3
DOI :
10.1109/ALLERTON.2010.5707067