• DocumentCode
    2423044
  • Title

    Arimoto channel coding converse and Rényi divergence

  • Author

    Polyanskiy, Yury ; Verdu, Sergio

  • Author_Institution
    Dept. of Electr. Eng., Princeton Univ., Princeton, NJ, USA
  • fYear
    2010
  • fDate
    Sept. 29 2010-Oct. 1 2010
  • Firstpage
    1327
  • Lastpage
    1333
  • Abstract
    Arimoto proved a non-asymptotic upper bound on the probability of successful decoding achievable by any code on a given discrete memoryless channel. In this paper we present a simple derivation of the Arimoto converse based on the data-processing inequality for Rényi divergence. The method has two benefits. First, it generalizes to codes with feedback and gives the simplest proof of the strong converse for the DMC with feedback. Second, it demonstrates that the sphere-packing bound is strictly tighter than Arimoto converse for all channels, blocklengths and rates, since in fact we derive the latter from the former. Finally, we prove similar results for other (non-Rényi) divergence measures.
  • Keywords
    channel coding; decoding; memoryless systems; Arimoto channel coding converse; Renyi divergence; blocklength; data-processing inequality; decoding probability; discrete memoryless channel; nonasymptotic upper bound; sphere-packing bound; Atmospheric measurements; Channel estimation; Decoding; Entropy; Markov processes; Memoryless systems; Random variables; Rényi divergence; Shannon theory; feedback; information measures; strong converse;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Communication, Control, and Computing (Allerton), 2010 48th Annual Allerton Conference on
  • Conference_Location
    Allerton, IL
  • Print_ISBN
    978-1-4244-8215-3
  • Type

    conf

  • DOI
    10.1109/ALLERTON.2010.5707067
  • Filename
    5707067