Title :
Fixed-Length Lossy Compression in the Finite Blocklength Regime
Author :
Kostina, Victoria ; Verdú, Sergio
Author_Institution :
Dept. of Electr. Eng., Princeton Univ., Princeton, NJ, USA
fDate :
6/1/2012 12:00:00 AM
Abstract :
This paper studies the minimum achievable source coding rate as a function of blocklength n and probability ϵ that the distortion exceeds a given level d . Tight general achievability and converse bounds are derived that hold at arbitrary fixed blocklength. For stationary memoryless sources with separable distortion, the minimum rate achievable is shown to be closely approximated by R(d) + √V(d)/(n) Q-1(ϵ), where R(d) is the rate-distortion function, V(d) is the rate dispersion, a characteristic of the source which measures its stochastic variability, and Q-1(·) is the inverse of the standard Gaussian complementary cumulative distribution function.
Keywords :
low-pass filters; optimisation; signal reconstruction; binary functions; low frequency measurements; low-pass filter; partial frequency information; reconstruction; simple linear optimization; Distortion measurement; Frequency modulation; Mean square error methods; Rate distortion theory; Rate-distortion; Source coding; Achievability; Shannon theory; converse; finite blocklength regime; lossy source coding; memoryless sources; rate distortion;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2012.2186786