Semi-automatic Evaluation System for Supporting Term Extraction Application Development

Important term extraction from the current web page is a common process in many client-based web applications such as query-free search, search query recommendation, information extraction, user profiling, and personalization. However, the tuning cost is large for deciding parameters when updating modules or dictionaries, or when porting an application for other languages or devices. We propose an evaluation system to collect web pages and corresponding correct data with visual check and automatic tuning of parameters. We confirmed the practicality of this system through the development and the two-month refinement of first query term extraction module.