Title :
Evaluation of question classification systems using differing features
Author :
Harb, A. ; Beigbeder, M. ; Girardot, J.-J.
Author_Institution :
Ecole Nat. Sup´erieure des Mines de St.-Etienne, St. Etienne, France
Abstract :
Most question and answer systems??Q&A?? are based on three research themes: question classification and analysis, document retrieval and answer extraction. The performance in every stage affects the final result. The classification of questions appears as an important task because it deduces the type of expected answers. A method of improving the performance of question classification is presented, based on linguistic analysis (semantic, syntactic and morphological) as well as statistical approaches guided by a layered semantic hierarchy of fine grained question types. Actually, methods of question expansion are studied. This method adds for each word a higher representation. Various features of questions, diverse term weightings and several machine learning algorithms are compared. Experiments were conducted on real data are presented. They demonstrate an improvement in precision for question classification.
Keywords :
information retrieval; learning (artificial intelligence); linguistics; pattern classification; statistical analysis; answer extraction; answer systems; document retrieval; linguistic analysis; machine learning algorithms; question classification system evaluation; statistical approach; Classification tree analysis; Decision trees; Machine learning; Machine learning algorithms; Performance analysis; Search engines; Support vector machine classification; Support vector machines; Taxonomy; Text analysis;
Conference_Titel :
Internet Technology and Secured Transactions, 2009. ICITST 2009. International Conference for
Conference_Location :
London
Print_ISBN :
978-1-4244-5647-5
DOI :
10.1109/ICITST.2009.5402567
