Title :
Nonsmooth nonnegative matrix factorization (nsNMF)
Author :
Pascual-Montano, Alberto ; Carazo, J.M. ; Kochi, Kieko ; Lehmann, Dietrich ; Pascual-Marqui, Roberto D.
Author_Institution :
Dept. of Comput. Archit. & Syst. Eng., Univ. Complutense, Madrid, Spain
fDate :
3/1/2006 12:00:00 AM
Abstract :
We propose a novel nonnegative matrix factorization model that aims at finding localized, part-based, representations of nonnegative multivariate data items. Unlike the classical nonnegative matrix factorization (NMF) technique, this new model, denoted "nonsmooth nonnegative matrix factorization" (nsNMF), corresponds to the optimization of an unambiguous cost function designed to explicitly represent sparseness, in the form of nonsmoothness, which is controlled by a single parameter. In general, this method produces a set of basis and encoding vectors that are not only capable of representing the original data, but they also extract highly focalized patterns, which generally lend themselves to improved interpretability. The properties of this new method are illustrated with several data sets. Comparisons to previously published methods show that the new nsNMF method has some advantages in keeping faithfulness to the data in the achieving a high degree of sparseness for both the estimated basis and the encoding vectors and in better interpretability of the factors.
Keywords :
matrix decomposition; optimisation; interpretability improvement; localized part-based representations; nonnegative multivariate data items; nonsmooth nonnegative matrix factorization; unambiguous cost function optimization; Constraint optimization; Cost function; Data mining; Design optimization; Encoding; Feature extraction; Independent component analysis; Matrix decomposition; Sparse matrices; Vectors; Index Terms- nonnegative matrix factorization; and very large systems.; constrained optimization; datamining; feature extraction or construction; mining methods and algorithms; pattern analysis; sparse; structured; Algorithms; Artificial Intelligence; Computer Simulation; Diagnosis, Computer-Assisted; Electroencephalography; Face; Humans; Image Interpretation, Computer-Assisted; Pattern Recognition, Automated; Sensitivity and Specificity; Software;
Journal_Title :
Pattern Analysis and Machine Intelligence, IEEE Transactions on
DOI :
10.1109/TPAMI.2006.60