Title :
A nonparametric Bayesian model for kernel matrix completion
Author :
Paisley, John ; Carin, Lawrence
Author_Institution :
Dept. of Electr. & Comput. Eng., Duke Univ., Durham, NC, USA
Abstract :
We present a nonparametric Bayesian model for completing low-rank, positive semidefinite matrices. Given an N × N matrix with underlying rank r, and noisy measured values and missing values with a symmetric pattern, the proposed Bayesian hierarchical model nonparametrically uncovers the underlying rank from all positive semidefinite matrices, and completes the matrix by approximating the missing values. We analytically derive all posterior distributions for the fully conjugate model hierarchy and discuss variational Bayes and MCMC Gibbs sampling for inference, as well as an efficient measurement selection procedure. We present results on a toy problem, and a music recommendation problem, where we complete the kernel matrix of 2,250 pieces of music.
Keywords :
Markov processes; Monte Carlo methods; belief networks; inference mechanisms; matrix algebra; signal sampling; Bayesian hierarchical model; MCMC Gibbs sampling; fully conjugate model hierarchy; kernel matrix completion; music recommendation problem; nonparametric Bayesian model; semidefinite matrices; toy problem; variational Bayes; Bayesian methods; Eigenvalues and eigenfunctions; Interpolation; Kernel; Large-scale systems; Learning systems; Recommender systems; Sampling methods; Sparse matrices; Symmetric matrices; Bayesian nonparametrics; kernel matrix completion; music recommendation;
Conference_Titel :
Acoustics Speech and Signal Processing (ICASSP), 2010 IEEE International Conference on
Conference_Location :
Dallas, TX
Print_ISBN :
978-1-4244-4295-9
Electronic_ISBN :
1520-6149
DOI :
10.1109/ICASSP.2010.5495105