Title : 
Lower bounds on the rate-distortion function of individual LDGM codes
         
        
            Author : 
Kudekar, Shrinivas ; Urbanke, Rüdiger
         
        
            Author_Institution : 
Sch. of Comput. & Commun. Sci., Ecole Polytech. Fed. de Lausanne, Lausanne
         
        
        
        
        
        
            Abstract : 
We consider lossy compression of a binary symmetric source by means of a low-density generator-matrix code. We derive two lower bounds on the rate distortion function which are valid for any low-density generator-matrix code with a given node degree distribution L(x) on the set of generators and for any encoding algorithm. These bounds show that, due to the sparseness of the code, the performance is strictly bounded away from the Shannon rate-distortion function. In this sense, our bounds represent a natural generalization of Gallagerpsilas bound on the maximum rate at which low-density parity-check codes can be used for reliable transmission. Our bounds are inspired by the recent work of Dimakis, Wainwright, and Ramchandran, but they apply to individual codes.
         
        
            Keywords : 
data compression; encoding; parity check codes; rate distortion theory; Gallager bound; encoding algorithm; lossy compression; low-density generator-matrix code; low-density parity-check codes; node degree distribution; rate-distortion function; Belief propagation; Distributed computing; Iterative algorithms; Magnetic resonance; Parity check codes; Random variables; Rate distortion theory; Rate-distortion; Sparse matrices; Turbo codes;
         
        
        
        
            Conference_Titel : 
Turbo Codes and Related Topics, 2008 5th International Symposium on
         
        
            Conference_Location : 
Lausanne
         
        
            Print_ISBN : 
978-1-4244-2862-5
         
        
            Electronic_ISBN : 
978-1-4244-2863-2
         
        
        
            DOI : 
10.1109/TURBOCODING.2008.4658729