Title :
Joint estimation of multiple undirected graphical models
Author :
Alexandros, Georgogiannis ; Digalakis, Vassilios
Author_Institution :
Sch. of Electr. & Comput. Eng., Tech. Univ. of Crete, Chania, Greece
Abstract :
Gaussian graphical models are of great interest in statistical learning. Since the conditional independence between the variables corresponds to zero entries in the inverse covariance matrix, one can learn the structure of the graph by estimating a sparse inverse covariance matrix from sample data. This is usually done by solving a convex maximum likelihood problem with a l1-regularization term applied on the inverse covariance matrix. In this study, we develop an estimator for such models appropriate for data coming from several datasets that share the same set of variables and a common network substructure. We assume that there exist a few different edges among the networks while the others (edges) are common. To this end, we form an optimization problem that exploits the problem´s special structure and we propose an alternating direction method for its solution. We confirm the performance improvement of our method over existing methods in finding the dependence structure on a real dataset.
Keywords :
Gaussian processes; covariance matrices; graph theory; learning (artificial intelligence); matrix inversion; maximum likelihood estimation; Gaussian graphical model; alternating direction method; conditional independence; convex maximum likelihood problem; joint estimation; network substructure; sparse inverse covariance matrix; statistical learning; undirected graphical models; zero entry; Covariance matrices; Estimation; Graphical models; Joints; Periodic structures; Proteins; Sparse matrices;
Conference_Titel :
Machine Learning for Signal Processing (MLSP), 2014 IEEE International Workshop on
Conference_Location :
Reims
DOI :
10.1109/MLSP.2014.6958915