Title :
Joint Learning of Multiple Sparse Matrix Gaussian Graphical Models
Author :
Feihu Huang ; Songcan Chen
Author_Institution :
Coll. of Comput. Sci. & Technol., Nanjing Univ. of Aeronaut. & Astronaut., Nanjing, China
Abstract :
We consider joint learning of multiple sparse matrix Gaussian graphical models and propose the joint matrix graphical Lasso to discover the conditional independence structures among rows (columns) in the matrix variable under distinct conditions. The proposed approach borrows strength across the different graphical models and is based on the maximum likelihood with penalized row and column precision matrices, respectively. In particular, our model is more parsimonious and flexible than the joint vector graphical models. Furthermore, we establish the asymptotic properties of our model on consistency and sparsistency.1 And the asymptotic analysis shows that our model enjoys a better convergence rate than the joint vector graphical models. Extensive simulation experiments demonstrate that our methods outperform state-of-the-art methods in identifying graphical structures and estimating precision matrices. Moreover, the effectiveness of our methods is also illustrated via a real data set analysis.
Keywords :
Gaussian processes; data analysis; graph theory; learning (artificial intelligence); maximum likelihood estimation; sparse matrices; column precision matrices; conditional independence structures; graphical structures; joint learning; joint matrix graphical Lasso; maximum likelihood; multiple sparse matrix Gaussian graphical models; real data set analysis; row precision matrices; Analytical models; Convergence; Covariance matrices; Graphical models; Joints; Sparse matrices; Vectors; Consistency; Gaussian graphical models; matrix normal distribution; precision matrix; sparsistency; sparsistency.;
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
DOI :
10.1109/TNNLS.2014.2384201