DocumentCode :
2976573
Title :
SRFW: a simple, fast and effective text classification algorithm
Author :
Deng, Zhi-Hong ; Tang, Shi-Wei ; Yang, Dong-Qing ; Zhang, Ming ; Wu, Xiao-Bin ; Yang, Meng
Author_Institution :
Dept. of Comput. Sci. & Technol., Peking Univ., Beijing, China
Volume :
3
fYear :
2002
fDate :
2002
Firstpage :
1267
Abstract :
Text classification is a powerful technique for automating assignment of documents to topic hierarchies. Although there are a number of text classification algorithms, most of them are either inefficient or too complex. We present a linear text classification algorithm called SRFW, which is fast, effective and easily used. SRFW obtains relevance factors. For new unlabelled documents, SRFW adopts sum of weights based on relevance factors to obtain the probability that these documents belong to each category and assigns them to categories that have the biggest probability. We have evaluated our algorithm on a subset of Reuters-21578 and 20-newsgroups text collections and compared it against k-NN and SVM. Experimental results show that SRFW is competitive with k nearest neighbor (k-NN) and support vector machines (SVM), while SRFW is much simpler and faster than them.
Keywords :
information retrieval; learning automata; natural languages; pattern classification; text analysis; 20-newsgroups text collection; Reuters-21578 text collection; SRFW; discriminating power; documents assignment; k-nearest neighbor method; linear text classification algorithm; relevance factors; statistical methods; support vector machines; topic hierarchies; unlabelled documents; Classification algorithms; Computer science; Electronic mail; Laboratories; Nearest neighbor searches; Neural networks; Probability; Support vector machine classification; Support vector machines; Text categorization;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Machine Learning and Cybernetics, 2002. Proceedings. 2002 International Conference on
Print_ISBN :
0-7803-7508-4
Type :
conf
DOI :
10.1109/ICMLC.2002.1167407
Filename :
1167407
Link To Document :
بازگشت