A new algorithm: Extracting text information from Webpage based on block and tag-function

A Webpage contains lots of information that users needed, however it also fills with plenty of noises. How to remove these noises and extract useful text information has become one of the hottest topics in the field of Web data mining. This paper proposes a text information extraction algorithm based on visual information and tag-function. In this algorithm, firstly a webpage is divided into different blocks, and then we extract text information from these blocks based on rules, which are extracted from the characteristics of tag-function. Experiments show that the algorithm is effective and efficient.