Title :
Improved methods for Monte Carlo estimation of the fisher information matrix
Author_Institution :
Appl. Phys. Lab., Johns Hopkins Univ., Laurel, MD
Abstract :
The Fisher information matrix summarizes the amount of information in a set of data relative to the quantities of interest and forms the basis for the Cramer-Rao (lower) bound on the uncertainty in an estimate. There are many applications of the information matrix in modeling, systems analysis, and estimation. This paper presents a resampling-based method for computing the information matrix together with some new theory related to efficient implementation. We show how certain properties associated with the likelihood function and the error in the estimates of the Hessian matrix can be exploited to improve the accuracy of the Monte Carlo- based estimate of the information matrix.
Keywords :
Hessian matrices; Monte Carlo methods; maximum likelihood estimation; Cramer-Rao bound; Fisher information matrix; Hessian matrix; Monte Carlo estimation; likelihood function; resampling-based method; Information analysis; Laboratories; Monte Carlo methods; Parameter estimation; Physics; System identification; Uncertainty; Cramér-Rao bound; Monte Carlo simulation; System identification; likelihood function; simultaneous perturbation (SPSA);
Conference_Titel :
American Control Conference, 2008
Conference_Location :
Seattle, WA
Print_ISBN :
978-1-4244-2078-0
Electronic_ISBN :
0743-1619
DOI :
10.1109/ACC.2008.4586850