• DocumentCode
    57668
  • Title

    Nonasymptotic and Second-Order Achievability Bounds for Coding With Side-Information

  • Author

    Watanabe, Shun ; Kuzuoka, Shigeaki ; Tan, Vincent Y. F.

  • Author_Institution
    Dept. of Inf. Sci. & Intell. Syst., Univ. of Tokushima, Tokushima, Japan
  • Volume
    61
  • Issue
    4
  • fYear
    2015
  • fDate
    Apr-15
  • Firstpage
    1574
  • Lastpage
    1605
  • Abstract
    We present a novel nonasymptotic or finite blocklength achievability bounds for three side-information problems in network information theory. These include: 1) the Wyner-Ahlswede-Körner (WAK) problem of almost-lossless source coding with rate-limited side-information; 2) the Wyner-Ziv (WZ) problem of lossy source coding with side-information at the decoder; and 3) the Gel´fand-Pinsker (GP) problem of channel coding with noncausal state information available at the encoder. The bounds are proved using ideas from channel simulation and channel resolvability. Our bounds for all three problems improve on all previous nonasymptotic bounds on the error probability of the WAK, WZ, and GP problems-in particular those derived by Verdú. Using our novel nonasymptotic bounds, we recover the general formulas for the optimal rates of these side-information problems. Finally, we also present achievable second-order coding rates by applying the multidimensional Berry-Esséen theorem to our new nonasymptotic bounds. Numerical results show that the second-order coding rates obtained using our nonasymptotic achievability bounds are superior to those obtained using existing finite blocklength bounds.
  • Keywords
    channel coding; decoding; error statistics; source coding; GP problem; Gelfand-Pinsker problem; WAK problem; WZ problem; Wyner-Ahlswede-Korner problem; Wyner-Ziv problem; achievable second-order coding rate; almost-lossless source coding; channel coding; channel resolvability; channel simulation; decoder; error probability; finite blocklength achievability bound; lossy source coding; multidimensional Berry-Esseen theorem; network information theory; nonasymptotic achievability bound; noncausal state information; optimal rates; rate-limited side-information; second-order achievability bound; side-information problem; Decoding; Error probability; Joints; Rate-distortion; Source coding; Gel’fand-Pinsker; Gel???fand-Pinsker; Source coding; Wyner-Ahlswede-K??rner; Wyner-Ahlswede-Korner; Wyner-Ziv; channel coding; finite blocklength; non-asymptotic; second-order coding rates; side-information;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2015.2400994
  • Filename
    7035099