Title :
On the dispersions of three network information theory problems
Author :
Tan, Vincent Y F ; Kosut, Oliver
Author_Institution :
Dept. of ECE, Univ. of Wisconsin-Madison, Madison, WI, USA
Abstract :
We characterize fundamental limits for the Slepian-Wolf problem, the multiple-access channel and the asymmetric broadcast channel in the finite blocklength setting. For the Slepian-Wolf problem (distributed lossless source coding), we introduce a fundamental quantity known as the entropy dispersion matrix. We show that if this matrix is positive-definite, the optimal rate region under the constraint of a fixed blocklength and non-zero error probability has a curved boundary compared to being polyhedral for the asymptotic Slepian-Wolf scenario. In addition, the entropy dispersion matrix governs the rate of convergence of the non-asymptotic region to the asymptotic one. We develop a general universal achievability procedure for finite blocklength analyses of other network information theory problems such as the multiple-access channel and broadcast channel. We provide inner bounds to these problems using a key result known as the vector rate redundancy theorem which is proved using a multidimensional version of the Berry-Essèen theorem. We show that a so-called information dispersion matrix characterizes these inner bounds.
Keywords :
broadcast channels; channel coding; entropy codes; error statistics; matrix algebra; source coding; Berry-Essèen theorem; asymmetric broadcast channel; asymptotic Slepian-Wolf problem; curved boundary; distributed lossless source coding; entropy dispersion matrix; finite block length analysis; information dispersion matrix; inner bounds; multiple-access channel; nonzero error probability; three network information theory problems; vector rate redundancy theorem; Covariance matrix; Decoding; Encoding; Entropy; Error probability; Vectors; Dispersion; Finite blocklength; Network information theory;
Conference_Titel :
Information Sciences and Systems (CISS), 2012 46th Annual Conference on
Conference_Location :
Princeton, NJ
Print_ISBN :
978-1-4673-3139-5
Electronic_ISBN :
978-1-4673-3138-8
DOI :
10.1109/CISS.2012.6310768