Title :
Kronecker graphical lasso
Author :
Tsiligkaridis, Theodoros ; Hero, Alfred O., III ; Zhou, Shuheng
Author_Institution :
EECS Dept., Univ. of Michigan, Ann Arbor, MI, USA
Abstract :
We consider high-dimensional estimation of a (possibly sparse) Kronecker-decomposable covariance matrix given i.i.d. Gaussian samples. We propose a sparse covariance estimation algorithm, Kronecker Graphical Lasso (KGlasso), for the high dimensional setting that takes advantage of structure and sparsity. Convergence and limit point characterization of this iterative algorithm is established. Compared to standard Glasso, KGlasso has low computational complexity as the dimension of the covariance matrix increases. We derive a tight MSE convergence rate for KGlasso and show it strictly outperforms standard Glasso and FF. Simulations validate these results and shows that KGlasso outperforms the maximum-likelihood solution (FF), in the high-dimensional small-sample regime.
Keywords :
computational complexity; covariance matrices; iterative methods; maximum likelihood estimation; KGlasso; Kronecker graphical lasso; Kronecker-decomposable covariance matrix; MSE convergence rate; computational complexity; high-dimensional estimation; iterative algorithm; limit point characterization; maximum-likelihood solution; sparse covariance estimation algorithm; Computational complexity; Convergence; Covariance matrix; Maximum likelihood estimation; Sparse matrices; Symmetric matrices; graphical lasso; penalized maximum likelihood; sparsity; structured covariance estimation;
Conference_Titel :
Statistical Signal Processing Workshop (SSP), 2012 IEEE
Conference_Location :
Ann Arbor, MI
Print_ISBN :
978-1-4673-0182-4
Electronic_ISBN :
pending
DOI :
10.1109/SSP.2012.6319849