Title :
Model of Data Gathering and Processing on Tibetan and Uyghur Language
Author :
Weng, Yu ; Jia, Hanxin ; Ma, Qingli
Author_Institution :
Coll. of Inf. Eng., Minzu Univ. of China, Beijing, China
Abstract :
A model of web data gathering and processing on Tibetan and Uyghur language is introduced in this paper, including page crawler, content extraction, word segmentation and frequency statistics and display. Firstly, It extracts the website\´s templates and use the template to extract the content and title of the web page, then the software transforms the HTML file to the XML file. The second step is to segment the content of XML file into words and to count the number of words, in order to store the statistics into database. Finally", "there is a web page to display the the result of the frequency statistics.
Keywords :
Web sites; XML; data handling; hypermedia markup languages; natural language processing; HTML; Tibetan language; Uyghur language; Web data gathering; Web page; Website templates; XML; content extraction; data processing; frequency statistics; page crawler; word segmentation; Data mining; Data models; Databases; Java; Transforms; Web pages; XML; Data Processing; Data gathering; Tibetan and Uyghur language;
Conference_Titel :
Intelligent Networks and Intelligent Systems (ICINIS), 2012 Fifth International Conference on
Conference_Location :
Tianjin
Print_ISBN :
978-1-4673-3083-1
DOI :
10.1109/ICINIS.2012.81
