Title :
BBS opinion leader mining based on an improved PageRank algorithm using MapReduce
Author :
Lincheng Jiang ; Bin Ge ; Weidong Xiao ; Mingze Gao
Author_Institution :
Sci. & Technol. on Inf. Syst. Eng. Lab., Nat. Univ. of Defense Technol., Changsha, China
Abstract :
Opinion leaders in bulletin board systems (BBS) play an important role during the formation of public opinion. Opinion leader mining has a positive effect on us to grasp and guide public opinion. The paper designs and implements an opinion leader mining system based on an improved PageRank algorithm using MapReduce. The improved PageRank algorithm uses the method of sentiment analysis to define the weight of the link between users. The system has three main steps. Firstly, adopt web crawler to crawl BBS data and preprocess the data collected. Then construct an online social network with the replying relations between posts and comments mapped to relations between posters and comment authors. Finally, use the improved PageRank algorithm to rank users in BBS in the Hadoop cloud computing environment. Contrast experiments with the origin Pagerank algorithm show that the system is accurate, efficient and practical.
Keywords :
cloud computing; parallel algorithms; social networking (online); BBS opinion leader mining; Hadoop cloud computing environment; MapReduce; bulletin board systems; improved PageRank algorithm; online social network; sentiment analysis; web crawler; Accuracy; Algorithm design and analysis; Cloud computing; Crawlers; Data mining; Program processors; BBS; Hadoop MapReduce; PageRank; opinion leader;
Conference_Titel :
Chinese Automation Congress (CAC), 2013
Conference_Location :
Changsha
Print_ISBN :
978-1-4799-0332-0
DOI :
10.1109/CAC.2013.6775766