• DocumentCode
    639936
  • Title

    On information-Estimation relationships over binomial and negative binomial models

  • Author

    Dongning Guo

  • Author_Institution
    Dept. of Electr. Eng. & Comput. Sci., Northwestern Univ., Evanston, IL, USA
  • fYear
    2013
  • fDate
    7-12 July 2013
  • Firstpage
    459
  • Lastpage
    463
  • Abstract
    In recent years, a number of results have been developed which connect information measures and estimation measures under various models, including, predominantly, Gaussian and Poisson models. More recent results due to Gil Taborda and Pérez-Cruz relate the relative entropy to certain mismatched estimation errors in the context of binomial and negative binomial models, where, unlike in the case of Gaussian and Poisson models, the conditional mean estimates concern models of different orders than those of the original model. In this paper, a different set of results in simple forms are developed for binomial and negative binomial models, where the conditional mean estimates are produced through the original models. The new results are consistent with previous results for Gaussian and Poisson models.
  • Keywords
    Gaussian processes; Poisson distribution; entropy; estimation theory; Gaussian model; Poisson model; conditional mean estimates concern models; estimation measures; information measures; information-estimation relationships; mismatched estimation errors; negative binomial models; relative entropy; Computational modeling; Context modeling; Entropy; Estimation; Mutual information; Random variables;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory Proceedings (ISIT), 2013 IEEE International Symposium on
  • Conference_Location
    Istanbul
  • ISSN
    2157-8095
  • Type

    conf

  • DOI
    10.1109/ISIT.2013.6620268
  • Filename
    6620268