Title :
Concavity of entropy under thinning
Author :
Yu, Yaming ; Johnson, Oliver
Author_Institution :
Dept. of Stat., Univ. of California, Irvine, CA, USA
fDate :
June 28 2009-July 3 2009
Abstract :
Building on the recent work of Johnson (2007) and Yu (2008), we prove that entropy is a concave function with respect to the thinning operation Talpha. That is, if X and Y are independent random variables on Z+ with ultra-log-concave probability mass functions, then H(TalphaX + T1-alphaY) ges alphaH(X) + (1 - alpha)H(Y), 0 les alpha les 1, where H denotes the discrete entropy. This is a discrete analogue of the inequality (h denotes the differential entropy) h(radicalphaX + radic1 - alphaY ) ges alphah(X) + (1 - alpha)h(Y), 0 les alpha les 1, which holds for continuous X and Y with finite variances and is equivalent to Shannon´s entropy power inequality. As a consequence we establish a special case of a conjecture of Shepp and Olkin (1981). Possible extensions are also discussed.
Keywords :
entropy; probability; concavity; discrete entropy; thinning; ultra-log-concave probability mass functions; Bismuth; Convergence; Convolution; Entropy; Heart; Information theory; Mathematics; Random variables; Statistics; Poisson distribution; binomial thinning; convolution; entropy power inequality; ultra-log-concavity;
Conference_Titel :
Information Theory, 2009. ISIT 2009. IEEE International Symposium on
Conference_Location :
Seoul
Print_ISBN :
978-1-4244-4312-3
Electronic_ISBN :
978-1-4244-4313-0
DOI :
10.1109/ISIT.2009.5205880