Integration and collection of heterogeneous data based on metedata

In order to solve the problem of heterogeneous data collection and integration in different industries, metadata-based retrieval model and rule-based web wrapper are proposed. Retrieval metadata set and industry retrieval model are constructed by applying metadata extraction technology, and the rule tree of industry data attributes is built and web wrapper is designed based on industry data format analysis. On the basis of above work, industry data collection system is realized to complete industry data collection. Through the study, researchers can obtain research data rapidly and accurately.