DocumentCode :
639936
Title :
On information-Estimation relationships over binomial and negative binomial models
Author :
Dongning Guo
Author_Institution :
Dept. of Electr. Eng. & Comput. Sci., Northwestern Univ., Evanston, IL, USA
fYear :
2013
fDate :
7-12 July 2013
Firstpage :
459
Lastpage :
463
Abstract :
In recent years, a number of results have been developed which connect information measures and estimation measures under various models, including, predominantly, Gaussian and Poisson models. More recent results due to Gil Taborda and Pérez-Cruz relate the relative entropy to certain mismatched estimation errors in the context of binomial and negative binomial models, where, unlike in the case of Gaussian and Poisson models, the conditional mean estimates concern models of different orders than those of the original model. In this paper, a different set of results in simple forms are developed for binomial and negative binomial models, where the conditional mean estimates are produced through the original models. The new results are consistent with previous results for Gaussian and Poisson models.
Keywords :
Gaussian processes; Poisson distribution; entropy; estimation theory; Gaussian model; Poisson model; conditional mean estimates concern models; estimation measures; information measures; information-estimation relationships; mismatched estimation errors; negative binomial models; relative entropy; Computational modeling; Context modeling; Entropy; Estimation; Mutual information; Random variables;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Information Theory Proceedings (ISIT), 2013 IEEE International Symposium on
Conference_Location :
Istanbul
ISSN :
2157-8095
Type :
conf
DOI :
10.1109/ISIT.2013.6620268
Filename :
6620268
Link To Document :
بازگشت