Title :
Minimum cross-entropy estimation with inaccurate side information
Author :
Campbell, L. Lorne
Author_Institution :
Dept. of Math. & Stat., Queen´´s Univ., Kingston, Ont., Canada
fDate :
11/1/1999 12:00:00 AM
Abstract :
Given a prior estimate of a probability, q, and a constraint Σpixi=a, one well-known way of estimating p is to minimize the cross-entropy I(p; q) subject to the constraint. A modification to this method is proposed for use when the value a is only approximately known. The modification is based on the penalty function method in constrained optimization. It has an interpretation in differential geometry methods in statistics and it sometimes gives a maximum-likelihood estimate
Keywords :
differential geometry; maximum likelihood estimation; minimum entropy methods; optimisation; probability; MLE; constrained optimization; differential geometry methods; inaccurate side information; maximum-likelihood estimate; minimum cross-entropy estimation; penalty function method; probability estimate; statistics; Constraint optimization; Councils; Entropy; Information geometry; Information theory; Life estimation; Maximum likelihood estimation; Probability; Random variables; Statistics;
Journal_Title :
Information Theory, IEEE Transactions on