Title :
Information-theoretic inequalities for contoured probability distributions
Author :
Guleryuz, Onur G. ; Lutwak, Erwin ; Yang, Deane ; Zhang, Gaoyong
Author_Institution :
Dept. of Math., Polytech. Univ. Brooklyn, NY, USA
fDate :
8/1/2002 12:00:00 AM
Abstract :
We show that for a special class of probability distributions that we call contoured distributions, information-theoretic invariants and inequalities are equivalent to geometric invariants and inequalities of bodies in Euclidean space associated with the distributions. Using this, we obtain characterizations of contoured distributions with extremal Shannon and Renyi entropy. We also obtain a new reverse information-theoretic inequality for contoured distributions.
Keywords :
information theory; probability; Euclidean space; contoured probability distributions; extremal Renyi entropy; extremal Shannon entropy; geometric inequalities; geometric invariants; information-theoretic inequalities; information-theoretic invariants; reverse information-theoretic inequality; Entropy; Gaussian distribution; Information geometry; Information theory; Laboratories; Level set; Mathematics; Probability density function; Probability distribution; Symmetric matrices;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2002.800496