Title :
Identifying the uncertainty structure using maximum likelihood estimation
Author :
Zagrobelny, Megan A. ; Rawlings, James B.
Author_Institution :
Dept. of Chem. & Biol. Eng., Univ. of Wisconsin-Madison, Madison, WI, USA
Abstract :
The identification of accurate disturbance models from data has application both to estimator design and controller performance monitoring. Methods to find the disturbance model include maximum likelihood estimation, Bayesian estimation, covariance matching, correlation techniques (such as autocovariance least-squares), and subspace identification methods. Here we formulate a maximum likelihood estimation (MLE) problem for the unknown process and measurement noise covariances. To form the MLE problem, the entire set of measurements is written as a linear combination of the white noises affecting the system. This measurement signal then has a multivariate normal distribution with a known mean and unknown variance. Since the structure of the variance is known, the likelihood is expressed in terms of the unknown process and measurement noise covariance matrices. The MLE problem is a nonlinear optimization problem for these covariances. A solution to this problem is shown to exist. Necessary conditions for uniqueness are shown to be the same as those for the autocovariance least-squares problem. While the size of the measurement signal makes the problem computationally demanding, the symmetry and sparsity of the problem aid in the numerical optimization. Simulations demonstrate the effectiveness of the MLE problem in finding the process and measurement noise covariances for low-dimensional systems. The MLE method is compared to existing approaches, and fruitful avenues of future research are discussed.
Keywords :
Bayes methods; covariance matrices; least squares approximations; maximum likelihood estimation; nonlinear programming; normal distribution; signal processing; Bayesian estimation; MLE problem; autocovariance least-squares; autocovariance least-squares problem; controller performance monitoring; correlation techniques; covariance matching; disturbance models; estimator design; known mean; low-dimensional systems; maximum likelihood estimation; measurement noise covariance matrices; measurement signal; multivariate normal distribution; necessary conditions; nonlinear optimization problem; numerical optimization; problem sparsity; problem symmetry; subspace identification methods; uncertainty structure identification; unknown process; unknown variance; white noises; Covariance matrices; Linear programming; Maximum likelihood estimation; Noise; Noise measurement; Optimization; Sparse matrices;
Conference_Titel :
American Control Conference (ACC), 2015
Conference_Location :
Chicago, IL
Print_ISBN :
978-1-4799-8685-9
DOI :
10.1109/ACC.2015.7170772