DocumentCode
506588
Title
An improved method of term weighting for text classification
Author
Jiang, Hua ; Li, Ping ; Hu, Xin ; Wang, Shuyan
Author_Institution
Sch. of Comput. Sci., Northeast Normal Univ., Changchun, China
Volume
1
fYear
2009
fDate
20-22 Nov. 2009
Firstpage
294
Lastpage
298
Abstract
In text classification, term weighting methods design appropriate weights to the given terms to improve the text classification performance. Traditional algorithm of term weighting only considers about tf (term frequency), idf (inverse document frequency) and so on, and this approach simply thinks low frequency terms are important, high frequency terms are unimportant, so it designs higher weights to the rare terms frequently. In this paper, we present an effective term weighting approach to avoid the deficiency of the traditional approach, and make use of kNN classifiers to classify over widely-used benchmark data set Reuters-21578. The experimental results prove that the new approach can improve the accuracy of classification.
Keywords
pattern classification; text analysis; Reuters-21578 benchmark data set; high frequency terms; inverse document frequency; kNN classifiers; low frequency terms; term frequency; term weighting methods; text classification; Algorithm design and analysis; Computer science; Data mining; Delta modulation; Design methodology; Frequency; Information retrieval; Information theory; Performance gain; Text categorization; Text classification; kNN; term weighting; tf-idf;
fLanguage
English
Publisher
ieee
Conference_Titel
Intelligent Computing and Intelligent Systems, 2009. ICIS 2009. IEEE International Conference on
Conference_Location
Shanghai
Print_ISBN
978-1-4244-4754-1
Electronic_ISBN
978-1-4244-4738-1
Type
conf
DOI
10.1109/ICICISYS.2009.5357842
Filename
5357842
Link To Document