Title : 
Convergence of differential entropies
         
        
            Author : 
Godavarti, Mahesh ; Hero, Alfred
         
        
            Author_Institution : 
Ditech Commun., Inc., Mountain View, CA, USA
         
        
        
        
        
        
        
            Abstract : 
Calculation of the differential entropy of the limiting density of a sequence of probability density functions (pdf) is an interesting mathematical problem and is important in asymptotic analysis of communication systems. In such cases, it would be of interest to know if the limit of the differential entropies Hn, corresponding to the sequence of pdf fn, is equal to the differential entropy H, of the limiting pdf f. In this correspondence, we establish sufficient conditions under which Hn → H.
         
        
            Keywords : 
convergence; entropy; probability; sequences; asymptotic analysis; communication systems; convergence; differential entropies; differential entropy; limiting density; pdf sequence; probability density functions; Convergence; Covariance matrix; Eigenvalues and eigenfunctions; Entropy; Interference cancellation; Interference suppression; Multiaccess communication; Notice of Violation; Random variables; System performance;
         
        
        
            Journal_Title : 
Information Theory, IEEE Transactions on
         
        
        
        
        
            DOI : 
10.1109/TIT.2003.821979