Title :
On Universal Properties of Capacity-Approaching LDPC Code Ensembles
Author_Institution :
Dept. of Electr. Eng., Technion - Israel Inst. of Technol., Haifa
fDate :
7/1/2009 12:00:00 AM
Abstract :
This paper is focused on the derivation of some universal properties of capacity-approaching low-density parity-check (LDPC) code ensembles whose transmission takes place over memoryless binary-input output-symmetric (MBIOS) channels. Properties of the degree distributions, graphical complexity, and the number of fundamental cycles in the bipartite graphs are considered via the derivation of information-theoretic bounds. These bounds are expressed in terms of the target block/bit error probability and the gap (in rate) to capacity. Most of the bounds are general for any decoding algorithm, and some others are proved under belief propagation (BP) decoding. Proving these bounds under a certain decoding algorithm, validates them automatically also under any suboptimal decoding algorithm. A proper modification of these bounds makes them universal for the set of all MBIOS channels which exhibit a given capacity. Bounds on the degree distributions and graphical complexity apply to finite-length LDPC codes and to the asymptotic case of an infinite block length. The bounds are compared with capacity-approaching LDPC code ensembles under BP decoding, and they are shown to be informative and are easy to calculate. Finally, some interesting open problems are considered.
Keywords :
channel capacity; channel coding; decoding; error statistics; graph theory; memoryless systems; parity check codes; belief propagation decoding algorithm; bipartite graphs; capacity-approaching LDPC code; information-theoretic bound; low-density parity-check code; memoryless binary-input output-symmetric channel; target block-bit error probability; Belief propagation; Bipartite graph; Capacity planning; Constraint optimization; Error probability; Information theory; Iterative algorithms; Iterative decoding; Maximum likelihood decoding; Parity check codes; Belief propagation (BP); bipartite graphs; complexity; cycles; density evolution (DE); linear programming (LP) bounds; low-density parity-check (LDPC) codes; maximum-likelihood (ML) decoding; memoryless binary-input output-symmetric (MBIOS) channels; sphere-packing bounds; stability;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2009.2021305