DocumentCode
639935
Title
Generalized Bregman divergence and gradient of mutual information for vector Poisson channels
Author
Liming Wang ; Rodrigues, M. ; Carin, Lawrence
Author_Institution
Dept. of Electr. & Comput. Eng., Duke Univ., Durham, NC, USA
fYear
2013
fDate
7-12 July 2013
Firstpage
454
Lastpage
458
Abstract
We investigate connections between information-theoretic and estimation-theoretic quantities in vector Poisson channel models. In particular, we generalize the gradient of mutual information with respect to key system parameters from the scalar to the vector Poisson channel model. We also propose, as another contribution, a generalization of the classical Bregman divergence that offers a means to encapsulate under a unifying framework the gradient of mutual information results for scalar and vector Poisson and Gaussian channel models. The so-called generalized Bregman divergence is also shown to exhibit various properties akin to the properties of the classical version. The vector Poisson channel model is drawing considerable attention in view of its application in various domains: as an example, the availability of the gradient of mutual information can be used in conjunction with gradient descent methods to effect compressive-sensing projection designs in emerging X-ray and document classification applications.
Keywords
Gaussian channels; Poisson distribution; estimation theory; information theory; Gaussian channel models; classical Bregman divergence; compressive-sensing projection designs; estimation-theoretic quantities; gradient descent methods; information-theoretic quantities; key system parameters; mutual information; scalar Poisson channel models; unifying framework; vector Poisson channel models; Channel estimation; Channel models; Dark current; Mutual information; Optimization; Vectors;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory Proceedings (ISIT), 2013 IEEE International Symposium on
Conference_Location
Istanbul
ISSN
2157-8095
Type
conf
DOI
10.1109/ISIT.2013.6620267
Filename
6620267
Link To Document