DocumentCode
2423044
Title
Arimoto channel coding converse and Rényi divergence
Author
Polyanskiy, Yury ; Verdu, Sergio
Author_Institution
Dept. of Electr. Eng., Princeton Univ., Princeton, NJ, USA
fYear
2010
fDate
Sept. 29 2010-Oct. 1 2010
Firstpage
1327
Lastpage
1333
Abstract
Arimoto proved a non-asymptotic upper bound on the probability of successful decoding achievable by any code on a given discrete memoryless channel. In this paper we present a simple derivation of the Arimoto converse based on the data-processing inequality for Rényi divergence. The method has two benefits. First, it generalizes to codes with feedback and gives the simplest proof of the strong converse for the DMC with feedback. Second, it demonstrates that the sphere-packing bound is strictly tighter than Arimoto converse for all channels, blocklengths and rates, since in fact we derive the latter from the former. Finally, we prove similar results for other (non-Rényi) divergence measures.
Keywords
channel coding; decoding; memoryless systems; Arimoto channel coding converse; Renyi divergence; blocklength; data-processing inequality; decoding probability; discrete memoryless channel; nonasymptotic upper bound; sphere-packing bound; Atmospheric measurements; Channel estimation; Decoding; Entropy; Markov processes; Memoryless systems; Random variables; Rényi divergence; Shannon theory; feedback; information measures; strong converse;
fLanguage
English
Publisher
ieee
Conference_Titel
Communication, Control, and Computing (Allerton), 2010 48th Annual Allerton Conference on
Conference_Location
Allerton, IL
Print_ISBN
978-1-4244-8215-3
Type
conf
DOI
10.1109/ALLERTON.2010.5707067
Filename
5707067
Link To Document