Title :
Mining relevant text from unlabelled documents
Author :
Barbará, Daniel ; Domeniconi, Carlotta ; Kang, Ning
Author_Institution :
Inf. & Software Eng. Dept., George Mason Univ., Fairfax, VA, USA
Abstract :
Automatic classification of documents is an important area of research with many applications in the fields of document searching, forensics and others. Methods to perform classification of text rely on the existence of a sample of documents whose class labels are known. However, in many situations, obtaining this sample may not be an easy (or even possible) task. We focus on the classification of unlabelled documents into two classes: relevant and irrelevant, given a topic of interest. By dividing the set of documents into buckets (for instance, answers returned by different search engines), and using association rule mining to find common sets of words among the buckets, we can efficiently obtain a sample of documents that has a large percentage of relevant ones. This sample can be used to train models to classify the entire set of documents. We prove, via experimentation, that our method is capable of filtering relevant documents even in adverse conditions where the percentage of irrelevant documents in the buckets is relatively high.
Keywords :
classification; data mining; document handling; information filters; information retrieval; sampling methods; search engines; association rule mining; class labels; document filtering; document searching; forensics; relevant text; search engines; unlabelled document classification; Application software; Association rules; Content based retrieval; Data mining; Forensics; Image retrieval; Information retrieval; Search engines; Software engineering; Web pages;
Conference_Titel :
Data Mining, 2003. ICDM 2003. Third IEEE International Conference on
Print_ISBN :
0-7695-1978-4
DOI :
10.1109/ICDM.2003.1250959