Title :
New information-estimation results for poisson, binomial and negative binomial models
Author :
Taborda, Camilo G. ; Perez-Cruz, Fernando ; Dongning Guo
Author_Institution :
Signal Theor. & Commun. Dept., UC3M, Madrid, Spain
fDate :
June 29 2014-July 4 2014
Abstract :
In recent years, a number of mathematical relationships have been established between information measures and estimation measures for various models, including Gaussian, Poisson and binomial models. In this paper, it is shown that the second derivative of the input-output mutual information with respect to the input scaling can be expressed as the expectation of a certain Bregman divergence pertaining to the conditional expectations of the input and the input power. This result is similar to that found for the Gaussian model where the Bregman divergence therein is the square distance. In addition, the Poisson, binomial and negative binomial models are shown to be similar in the small scaling regime in the sense that the derivative of the mutual information and the derivative of the relative entropy converge to the same value.
Keywords :
Gaussian processes; information theory; stochastic processes; Bregman divergence; Gaussian models; Poisson models; estimation measures; information measures; information-estimation results; negative binomial models; Estimation;
Conference_Titel :
Information Theory (ISIT), 2014 IEEE International Symposium on
Conference_Location :
Honolulu, HI
DOI :
10.1109/ISIT.2014.6875225