Title :
Text Document Preprocessing with the Bayes Formula for Classification Using the Support Vector Machine
Author :
Isa, Dino ; Lee, Lam Hong ; Kallimani, V.P. ; RajKumar, R.
Author_Institution :
Malaysia Campus, Fac. of Eng. & Comput. Sci., Univ. of Nottingham, Semenyih
Abstract :
This work implements an enhanced hybrid classification method through the utilization of the naive Bayes approach and the support vector machine (SVM). In this project, the Bayes formula was used to vectorize (as opposed to classify) a document according to a probability distribution reflecting the probable categories that the document may belong to. The Bayes formula gives a range of probabilities to which the document can be assigned according to a predetermined set of topics (categories) such as those found in the "20 Newsgroups" data set for instance. Using this probability distribution as the vectors to represent the document, the SVM can then be used to classify the documents on a multidimensional level. The effects of an inadvertent dimensionality reduction caused by classifying using only the highest probability using the naive Bayes classifier can be overcome using the SVM by employing all the probability values associated with every category for each document. This method can be used for any data set and shows a significant reduction in training time as compared to the Lsquare method and significant improvement in the classification accuracy when compared to pure naive Bayes systems and also the TF-IDF/SVM hybrids.
Keywords :
Bayes methods; pattern classification; statistical distributions; support vector machines; text analysis; classification; naive Bayes classifier; probability distribution; support vector machine; text document preprocessing; Applications < Applications < Classifier design and evaluation < Classifier design and evaluation < Computing Methodologies; Design Methodology < Design Methodology < Document analysis; Document and Text Processing < Document and Text Processing < Pattern Recognition < Pattern Recognition < Text processing < Text processing <
Journal_Title :
Knowledge and Data Engineering, IEEE Transactions on
DOI :
10.1109/TKDE.2008.76