Title :
High performance in minimizing of term-document matrix representation for document clustering
Author :
Muflikhah, L. ; Baharudin, B.
Author_Institution :
Comput. & Inf. Sci. Dept., Univ. Teknol. PETRONAS, Tronoh, Malaysia
Abstract :
Document clustering usually involves high dimensional term space, which makes it difficult for organizing data into a small number of meaningful clusters. Clustering based on similar terms without considering the content or meaning is often unsatisfactory as it ignores the relationship between important terms that do not co-occur literally. In this paper, we propose to integrate the latent semantic indexing (LSI) concept to our document clustering. This involves the use of singular value decomposition (SVD) which creates a new abstract and uses a way of finding pattern document collection in matrix representation, so that it can identify between the terms and documents which are similar. By using various numbers of patterns (rank) of SVD, the proposed method is applied to cluster documents using the fuzzy C-means algorithm. The results of the experiment show that the performance of document clustering to be better when applied to the LSI method.
Keywords :
document handling; fuzzy set theory; indexing; matrix algebra; pattern clustering; singular value decomposition; document clustering; fuzzy C-means algorithm; high dimensional term space; latent semantic indexing; matrix representation; pattern document collection; singular value decomposition; Clustering algorithms; Indexing; Information retrieval; Intelligent systems; Large scale integration; Matrix decomposition; Natural language processing; Organizing; Singular value decomposition; Space technology;
Conference_Titel :
Innovative Technologies in Intelligent Systems and Industrial Applications, 2009. CITISIA 2009
Conference_Location :
Monash
Print_ISBN :
978-1-4244-2886-1
Electronic_ISBN :
978-1-4244-2887-8
DOI :
10.1109/CITISIA.2009.5224207