Title :
Dictionary Learning-Based Subspace Structure Identification in Spectral Clustering
Author :
Liping Jing ; Ng, Michael K. ; Tieyong Zeng
Author_Institution :
Comput. & Inf. Technol., Beijing Jiaotong Univ., Beijing, China
Abstract :
In this paper, we study dictionary learning (DL) approach to identify the representation of low-dimensional subspaces from high-dimensional and nonnegative data. Such representation can be used to provide an affinity matrix among different subspaces for data clustering. The main contribution of this paper is to consider both nonnegativity and sparsity constraints together in DL such that data can be represented effectively by nonnegative and sparse coding coefficients and nonnegative dictionary bases. In the algorithm, we employ the proximal point technique for the resulting DL and sparsity optimization problem. We make use of coding coefficients to perform spectral clustering (SC) for data partitioning. Extensive experiments on real-world high-dimensional and nonnegative data sets, including text, microarray, and image data demonstrate that the proposed method can discover their subspace structures. Experimental results also show that our algorithm is computationally efficient and effective for obtaining high SC performance and interpreting the clustering results compared with the other testing methods.
Keywords :
data structures; dictionaries; learning (artificial intelligence); pattern clustering; affinity matrix; data clustering; data partitioning; dictionary learning-based subspace structure identification; high-dimensional data; image data; low-dimensional subspace representation identification; microarray data; nonnegative data; nonnegative dictionary basis; nonnegativity constraint; proximal point technique; sparse coding coefficient; sparsity constrain; sparsity optimization problem; spectral clustering; subspace structure discovery; text data; Dictionary learning (DL); high-dimensional data; nonnegative data; proximal optimization; sparsity; spectral clustering (SC); subspace structure;
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
DOI :
10.1109/TNNLS.2013.2253123