Title :
On Monte Carlo methods for estimating the fisher information matrix in difficult problems
Author_Institution :
Appl. Phys. Lab., Johns Hopkins Univ., Laurel, MD
Abstract :
The Fisher information matrix summarizes the amount of information in a set of data relative to the quantities of interest and forms the basis for the Cramer-Rao (lower) bound on the uncertainty in an estimate. There are many applications of the information matrix in modeling, systems analysis, and estimation. This paper presents a resampling-based method for computing the information matrix together with some new theory related to efficient implementation. We show how certain properties associated with the likelihood function and the error in the estimates of the Hessian matrix can be exploited to improve the accuracy of the Monte Carlo-based estimate of the information matrix.
Keywords :
Hessian matrices; Monte Carlo methods; maximum likelihood estimation; Hessian matrix; Monte Carlo method; fisher information matrix estimation; likelihood function; parameter estimation; resampling-based method; system identification; Information analysis; Laboratories; Mathematics; Monte Carlo methods; Parameter estimation; Physics; Statistics; System identification; Uncertainty; Cramér-Rao bound; Monte Carlo simulation; System identification; likelihood function; simultaneous perturbation (SPSA);
Conference_Titel :
Information Sciences and Systems, 2009. CISS 2009. 43rd Annual Conference on
Conference_Location :
Baltimore, MD
Print_ISBN :
978-1-4244-2733-8
Electronic_ISBN :
978-1-4244-2734-5
DOI :
10.1109/CISS.2009.5054816
