Title :
The study and implementation of micro-blog search engine based on nutch
Author :
Zhang, Kai ; Du, Yuncheng ; Lv, Xueqiang ; Shi, Shuicai
Author_Institution :
Chinese Inf. Process. Res. Center, Beijing Inf. Sci. & Technol. Univ., Beijing, China
Abstract :
Through introducing and analyzing the new form of media called micro-blog, we have concluded the characteristics of micro-blog and website structure features. Then we gave concrete realization of the search engine based on nutch technology, and transformed the existing Chinese word segmentation system. Finally the search engine was built completely. After the analysis of the collected data, we found micro-blog site features. What is more, we found that five-depth was the best depth for micro-blog.
Keywords :
Web sites; data analysis; natural languages; search engines; text analysis; word processing; Chinese word segmentation system; Website structure features; collected data analysis; microblog search engine; nutch technology; Information processing; Information science; Information services; Information technology; Internet; Scattering; Search engines; Twitter; Uniform resource locators; Web sites; Micro-blog; Twitter; search engine; web gathering;
Conference_Titel :
Future Computer and Communication (ICFCC), 2010 2nd International Conference on
Conference_Location :
Wuhan
Print_ISBN :
978-1-4244-5821-9
DOI :
10.1109/ICFCC.2010.5497309
