Title :
FastNMF: A fast monotonic fixed-point non-negative Matrix Factorization algorithm with high ease of use
Author :
Li, Le ; Zhang, Yu-Jin
Author_Institution :
Tsinghua Nat. Lab. for Inf. Sci. & Technol., Tsinghua Univ., Beijing
Abstract :
Non-negative Matrix Factorization (NMF) is a recently developed method for dimensionality reduction, feature extraction and data mining, etc. Currently no NMF algorithm holds both satisfactory efficiency for applications and enough ease of use. To improve the applicability of NMF, this paper proposes a new monotonic, fixed-point algorithm coined FastNMF by implementing least squares error-based non-negative factorization essentially according to the basic properties of parabola functions. The minimization problem corresponding to an operation in FastNMF can be analytically solved just by this algorithm, which is far beyond all existing algorithmspsila power. Therefore, FastNMF holds much higher efficiency, which is validated by a number of experimental results. For the simplicity of design philosophy, FastNMF is still one of NMF algorithms that are the easiest to use and the most comprehensible. Besides, theoretical analysis and experimental results also show that FastNMF tends to converge to better solutions than the popular multiplicative update-based algorithms.
Keywords :
data mining; feature extraction; least squares approximations; matrix decomposition; minimisation; FastNMF; data mining; dimensionality reduction; fast monotonic fixed-point non-negative matrix factorization algorithm; feature extraction; fixed-point algorithm; least squares error-based non-negative factorization; minimization problem; multiplicative update-based algorithms; Algorithm design and analysis; Clustering algorithms; Data mining; Feature extraction; Information science; Iterative algorithms; Laboratories; Least squares methods; Minimization methods; Text analysis;
Conference_Titel :
Pattern Recognition, 2008. ICPR 2008. 19th International Conference on
Conference_Location :
Tampa, FL
Print_ISBN :
978-1-4244-2174-9
Electronic_ISBN :
1051-4651
DOI :
10.1109/ICPR.2008.4761256