• DocumentCode
    1613410
  • Title

    BBS opinion leader mining based on an improved PageRank algorithm using MapReduce

  • Author

    Lincheng Jiang ; Bin Ge ; Weidong Xiao ; Mingze Gao

  • Author_Institution
    Sci. & Technol. on Inf. Syst. Eng. Lab., Nat. Univ. of Defense Technol., Changsha, China
  • fYear
    2013
  • Firstpage
    392
  • Lastpage
    396
  • Abstract
    Opinion leaders in bulletin board systems (BBS) play an important role during the formation of public opinion. Opinion leader mining has a positive effect on us to grasp and guide public opinion. The paper designs and implements an opinion leader mining system based on an improved PageRank algorithm using MapReduce. The improved PageRank algorithm uses the method of sentiment analysis to define the weight of the link between users. The system has three main steps. Firstly, adopt web crawler to crawl BBS data and preprocess the data collected. Then construct an online social network with the replying relations between posts and comments mapped to relations between posters and comment authors. Finally, use the improved PageRank algorithm to rank users in BBS in the Hadoop cloud computing environment. Contrast experiments with the origin Pagerank algorithm show that the system is accurate, efficient and practical.
  • Keywords
    cloud computing; parallel algorithms; social networking (online); BBS opinion leader mining; Hadoop cloud computing environment; MapReduce; bulletin board systems; improved PageRank algorithm; online social network; sentiment analysis; web crawler; Accuracy; Algorithm design and analysis; Cloud computing; Crawlers; Data mining; Program processors; BBS; Hadoop MapReduce; PageRank; opinion leader;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Chinese Automation Congress (CAC), 2013
  • Conference_Location
    Changsha
  • Print_ISBN
    978-1-4799-0332-0
  • Type

    conf

  • DOI
    10.1109/CAC.2013.6775766
  • Filename
    6775766