Title :
Maximum-likelihood estimation of autoregressive models with conditional independence constraints
Author :
Songsiri, Jitkomut ; Dahl, Joachim ; Vandenberghe, Lieven
Author_Institution :
Dept. of Electr. Eng., Univ. of California, Los Angeles, CA
Abstract :
We propose a convex optimization method for maximum likelihood estimation of autoregressive models, subject to conditional independence constraints. This problem is an extension to times series of the classical covariance selection problem in graphical modeling. The conditional independence constraints impose quadratic equalities on the autoregressive model parameters, which makes the maximum likelihood estimation problem nonconvex and difficult to solve. We formulate a convex relaxation and prove that it is exact when the sample covariance matrix is block-Toeplitz. We also observe experimentally that in practice the relaxation is exact under much weaker conditions. We discuss applications to topology selection in graphical models of time series, by enumerating all possible topologies, and ranking them using information-theoretic model selection criteria. The method is illustrated by an example of air pollution data.
Keywords :
autoregressive processes; convex programming; covariance matrices; graph theory; maximum likelihood estimation; time series; autoregressive model; conditional independence constraint; convex optimization method; covariance matrix; graphical modeling; maximum likelihood estimation; quadratic equality; times series; topology model; Air pollution; Covariance matrix; Gaussian processes; Graphical models; Maximum likelihood estimation; Optimization methods; Random variables; Symmetric matrices; Tin; Topology; conditional independence; graphical models; model selection; semidefinite programming relaxation;
Conference_Titel :
Acoustics, Speech and Signal Processing, 2009. ICASSP 2009. IEEE International Conference on
Conference_Location :
Taipei
Print_ISBN :
978-1-4244-2353-8
Electronic_ISBN :
1520-6149
DOI :
10.1109/ICASSP.2009.4959930