DocumentCode :
939607
Title :
On the similarity of the entropy power inequality and the Brunn- Minkowski inequality (Corresp.)
Author :
Costa, Maice ; Cover, T.
Volume :
30
Issue :
6
fYear :
1984
fDate :
11/1/1984 12:00:00 AM
Firstpage :
837
Lastpage :
839
Abstract :
The entropy power inequality states that the effective variance (entropy power) of the sum of two independent random variables is greater than the sum of their effective variances. The Brunn-Minkowski inequality states that the effective radius of the set sum of two sets is greater than the sum of their effective radii. Both these inequalities are recast in a form that enhances their similarity. In spite of this similarity, there is as yet no common proof of the inequalities. Nevertheless, their intriguing similarity suggests that new results relating to entropies from known results in geometry and vice versa may be found. Two applications of this reasoning are presented. First, an isoperimetric inequality for entropy is proved that shows that the spherical normal distribution minimizes the trace of the Fisher information matrix given an entropy constraint--just as a sphere minimizes the surface area given a volume constraint. Second, a theorem involving the effective radii of growing convex sets is proved.
Keywords :
Entropy; Geometry; Set theory; Convolution; Covariance matrix; Entropy; Information theory; Random variables; Statistics; Volume measurement;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/TIT.1984.1056983
Filename :
1056983
Link To Document :
بازگشت