Title :
Nonasymptotic and Second-Order Achievability Bounds for Coding With Side-Information
Author :
Watanabe, Shun ; Kuzuoka, Shigeaki ; Tan, Vincent Y. F.
Author_Institution :
Dept. of Inf. Sci. & Intell. Syst., Univ. of Tokushima, Tokushima, Japan
Abstract :
We present a novel nonasymptotic or finite blocklength achievability bounds for three side-information problems in network information theory. These include: 1) the Wyner-Ahlswede-Körner (WAK) problem of almost-lossless source coding with rate-limited side-information; 2) the Wyner-Ziv (WZ) problem of lossy source coding with side-information at the decoder; and 3) the Gel´fand-Pinsker (GP) problem of channel coding with noncausal state information available at the encoder. The bounds are proved using ideas from channel simulation and channel resolvability. Our bounds for all three problems improve on all previous nonasymptotic bounds on the error probability of the WAK, WZ, and GP problems-in particular those derived by Verdú. Using our novel nonasymptotic bounds, we recover the general formulas for the optimal rates of these side-information problems. Finally, we also present achievable second-order coding rates by applying the multidimensional Berry-Esséen theorem to our new nonasymptotic bounds. Numerical results show that the second-order coding rates obtained using our nonasymptotic achievability bounds are superior to those obtained using existing finite blocklength bounds.
Keywords :
channel coding; decoding; error statistics; source coding; GP problem; Gelfand-Pinsker problem; WAK problem; WZ problem; Wyner-Ahlswede-Korner problem; Wyner-Ziv problem; achievable second-order coding rate; almost-lossless source coding; channel coding; channel resolvability; channel simulation; decoder; error probability; finite blocklength achievability bound; lossy source coding; multidimensional Berry-Esseen theorem; network information theory; nonasymptotic achievability bound; noncausal state information; optimal rates; rate-limited side-information; second-order achievability bound; side-information problem; Decoding; Error probability; Joints; Rate-distortion; Source coding; Gel’fand-Pinsker; Gel???fand-Pinsker; Source coding; Wyner-Ahlswede-K??rner; Wyner-Ahlswede-Korner; Wyner-Ziv; channel coding; finite blocklength; non-asymptotic; second-order coding rates; side-information;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2015.2400994