DocumentCode
639936
Title
On information-Estimation relationships over binomial and negative binomial models
Author
Dongning Guo
Author_Institution
Dept. of Electr. Eng. & Comput. Sci., Northwestern Univ., Evanston, IL, USA
fYear
2013
fDate
7-12 July 2013
Firstpage
459
Lastpage
463
Abstract
In recent years, a number of results have been developed which connect information measures and estimation measures under various models, including, predominantly, Gaussian and Poisson models. More recent results due to Gil Taborda and Pérez-Cruz relate the relative entropy to certain mismatched estimation errors in the context of binomial and negative binomial models, where, unlike in the case of Gaussian and Poisson models, the conditional mean estimates concern models of different orders than those of the original model. In this paper, a different set of results in simple forms are developed for binomial and negative binomial models, where the conditional mean estimates are produced through the original models. The new results are consistent with previous results for Gaussian and Poisson models.
Keywords
Gaussian processes; Poisson distribution; entropy; estimation theory; Gaussian model; Poisson model; conditional mean estimates concern models; estimation measures; information measures; information-estimation relationships; mismatched estimation errors; negative binomial models; relative entropy; Computational modeling; Context modeling; Entropy; Estimation; Mutual information; Random variables;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory Proceedings (ISIT), 2013 IEEE International Symposium on
Conference_Location
Istanbul
ISSN
2157-8095
Type
conf
DOI
10.1109/ISIT.2013.6620268
Filename
6620268
Link To Document