Title :
Probabilistic Analysis of Linear Programming Decoding
Author :
Daskalakis, Constantinos ; Dimakis, Alexandros G. ; Karp, Richard M. ; Wainwright, Martin J.
Author_Institution :
Dept. of Electr. Eng. & Comput. Sci., Univ. of Berkeley, Berkeley, CA
Abstract :
We initiate the probabilistic analysis of linear programming (LP) decoding of low-density parity-check (LDPC) codes. Specifically, we show that for a random LDPC code ensemble, the linear programming decoder of Feldman succeeds in correcting a constant fraction of errors with high probability. The fraction of correctable errors guaranteed by our analysis surpasses previous nonasymptotic results for LDPC codes, and in particular, exceeds the best previous finite-length result on LP decoding by a factor greater than ten. This improvement stems in part from our analysis of probabilistic bit-flipping channels, as opposed to adversarial channels. At the core of our analysis is a novel combinatorial characterization of LP decoding success, based on the notion of a flow on the Tanner graph of the code. An interesting by-product of our analysis is to establish the existence of ldquoprobabilistic expansionrdquo in random bipartite graphs, in which one requires only that almost every (as opposed to every) set of a certain size expands, for sets much larger than in the classical worst case setting.
Keywords :
channel coding; decoding; graph theory; linear programming; parity check codes; random codes; LDPC codes; Tanner graph; linear programming decoding; low-density parity-check codes; probabilistic analysis; probabilistic bit-flipping channels; random code ensemble; Algorithm design and analysis; Bipartite graph; Error correction; Error correction codes; Iterative algorithms; Iterative decoding; Linear programming; Maximum likelihood decoding; Parity check codes; Performance analysis; Binary-symmetric channel (BSC); channel coding; error-control coding; expanders; factor graphs; linear programming decoding; low-density parity-check (LDPC) codes; randomized algorithms; sum–product algorithm;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2008.926452