Title :
Optimum Tradeoffs Between the Error Exponent and the Excess-Rate Exponent of Variable-Rate Slepian–Wolf Coding
Author :
Weinberger, Nir ; Merhav, Neri
Author_Institution :
Dept. of Electr. Eng., Technion - Israel Inst. of Technol., Haifa, Israel
Abstract :
We analyze the optimal tradeoff between the error exponent and the excess-rate exponent for variable-rate Slepian-Wolf codes. In particular, we first derive upper (converse) bounds on the optimal error and excess-rate exponents, and then lower (achievable) bounds, via a simple class of variable-rate codes which assign the same rate to all source blocks of the same type class. Then, using the exponent bounds, we derive bounds on the optimal rate functions, namely, the minimal rate assigned to each type class, needed in order to achieve a given target error exponent. The resulting excess-rate exponent is then evaluated. Iterative algorithms are provided for the computation of both bounds on the optimal rate functions and their excess-rate exponents. The resulting Slepian-Wolf codes bridge between the two extremes of fixed-rate coding, which has minimal error exponent and maximal excess-rate exponent, and average-rate coding, which has maximal error exponent and minimal excess-rate exponent.
Keywords :
iterative methods; variable rate codes; achievable bounds; average-rate coding; converse bounds; excess-rate exponents; fixed-rate coding; iterative algorithms; lower bounds; optimal error exponents; optimal rate functions; source blocks; target error exponent; upper bounds; variable-rate Slepian-Wolf codes; Channel coding; Decoding; Entropy; Error probability; Reliability; Vectors; Slepian-Wolf coding; alternating minimization; buffer overflow; error exponent; excess-rate exponent; random-binning; reliability function; variable-rate coding;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2015.2405537