Title :
Convergence of differential entropies
Author :
Godavarti, Mahesh ; Hero, Alfred
Author_Institution :
Ditech Commun., Inc., Mountain View, CA, USA
Abstract :
Calculation of the differential entropy of the limiting density of a sequence of probability density functions (pdf) is an interesting mathematical problem and is important in asymptotic analysis of communication systems. In such cases, it would be of interest to know if the limit of the differential entropies Hn, corresponding to the sequence of pdf fn, is equal to the differential entropy H, of the limiting pdf f. In this correspondence, we establish sufficient conditions under which Hn → H.
Keywords :
convergence; entropy; probability; sequences; asymptotic analysis; communication systems; convergence; differential entropies; differential entropy; limiting density; pdf sequence; probability density functions; Convergence; Covariance matrix; Eigenvalues and eigenfunctions; Entropy; Interference cancellation; Interference suppression; Multiaccess communication; Notice of Violation; Random variables; System performance;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2003.821979