DocumentCode
1630337
Title
Non-asymptotic fixed-rate Slepian-Wolf coding theorem
Author
Duo Xu ; Jin Meng ; En-Hui Yang
Author_Institution
Dept. of Electr. & Comput. Eng., Univ. of Waterloo, Waterloo, ON, Canada
fYear
2012
Firstpage
640
Lastpage
647
Abstract
Traditionally, Slepian-Wolf (SW) coding theorem relies on source sequences with length tending to infinity. However, in practice, the source sequences are of finite length. Towards closing this gap, we obtain non-asymptotic achievability and non-asymptotic converse for the fixed-rate SW coding by applying the NEP theorem. Furthermore, combining those converse and achievability, we show that the best SW coding rate has a Taylor-type expansion with respect to δn(ϵ) which measures the relative magnitude of the error probability ϵ and block length n. In addition, based on the Taylor-type expansion, we develop some reliable approximations (dubbed SO and NEP) for Rn(ϵ). Numerical comparison with the converse and achievability further shows that while the normal approximation and redundancy approximation reported in the literature can be either below converse or above the achievability in some cases, the SO and NEP approximations are always reliable and can serve as the benchmark for practical SW code design.
Keywords
approximation theory; error statistics; source coding; NEP theorem; SW coding; Taylor-type expansion; block length; error probability; nonasymptotic fixed-rate Slepian-Wolf coding theorem; normal approximation; redundancy approximation; source sequences; Approximation methods; Decoding; Encoding; Entropy; Error probability; Redundancy; Tin;
fLanguage
English
Publisher
ieee
Conference_Titel
Communication, Control, and Computing (Allerton), 2012 50th Annual Allerton Conference on
Conference_Location
Monticello, IL
Print_ISBN
978-1-4673-4537-8
Type
conf
DOI
10.1109/Allerton.2012.6483278
Filename
6483278
Link To Document