• DocumentCode
    1630337
  • Title

    Non-asymptotic fixed-rate Slepian-Wolf coding theorem

  • Author

    Duo Xu ; Jin Meng ; En-Hui Yang

  • Author_Institution
    Dept. of Electr. & Comput. Eng., Univ. of Waterloo, Waterloo, ON, Canada
  • fYear
    2012
  • Firstpage
    640
  • Lastpage
    647
  • Abstract
    Traditionally, Slepian-Wolf (SW) coding theorem relies on source sequences with length tending to infinity. However, in practice, the source sequences are of finite length. Towards closing this gap, we obtain non-asymptotic achievability and non-asymptotic converse for the fixed-rate SW coding by applying the NEP theorem. Furthermore, combining those converse and achievability, we show that the best SW coding rate has a Taylor-type expansion with respect to δn(ϵ) which measures the relative magnitude of the error probability ϵ and block length n. In addition, based on the Taylor-type expansion, we develop some reliable approximations (dubbed SO and NEP) for Rn(ϵ). Numerical comparison with the converse and achievability further shows that while the normal approximation and redundancy approximation reported in the literature can be either below converse or above the achievability in some cases, the SO and NEP approximations are always reliable and can serve as the benchmark for practical SW code design.
  • Keywords
    approximation theory; error statistics; source coding; NEP theorem; SW coding; Taylor-type expansion; block length; error probability; nonasymptotic fixed-rate Slepian-Wolf coding theorem; normal approximation; redundancy approximation; source sequences; Approximation methods; Decoding; Encoding; Entropy; Error probability; Redundancy; Tin;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Communication, Control, and Computing (Allerton), 2012 50th Annual Allerton Conference on
  • Conference_Location
    Monticello, IL
  • Print_ISBN
    978-1-4673-4537-8
  • Type

    conf

  • DOI
    10.1109/Allerton.2012.6483278
  • Filename
    6483278