Quality-based data source selection for web-scale Deep Web data integration

Deep Web has been an important resource on the Web due to its rich and high quality information, leading to emerging a new application area in data mining and information retrieval and integrates. In Web scale deep Web data integration tasks, where there may be hundreds or thousands of data sources providing data of relevance to a particular domain, It must be inefficient to integrate all available deep Web sources. This paper proposes a data source selection approach based on the quality of deep Web source. It is used for automatic finding the highest quality set of deep Web sources related to a particular domain, which is a premise for effective deep Web data integration. The quality of data sources are assessed by evaluating quality dimensions represent the characteristics of deep Web source. Experiments running on real deep Web sources collected from the Internet show that our provides an effective and scalable solution for selecting data sources for deep Web data integration.