Title :
Social relation extraction of large-scale logistics network based on mapreduce
Author :
Feng Gui ; Feng Zhang ; Yunlong Ma ; Min Liu ; Weiming Shen
Author_Institution :
Sch. of Electron. & Inf. Eng., Tongji Univ., Shanghai, China
Abstract :
Social network is a social structure of nodes that are linked by various kinds of relationships, such as friends, web links, etc. To extract social relation based on logistics data will contribute significantly to detect some underlying crimes. One of the main difficulties in social relation extraction from massive data is the low time efficiency. Fortunately, large scale parallel computation has been proved that it has an excellent capacity to cope with big data. In this paper, a MapReduce-based method was applied for extraction of social relation from logistics network using Hadoop platform. Experimental results showed that the proposed method improves the time efficiency well, and has more excellent scalability than traditional methods executed by a single machine.
Keywords :
Big Data; logistics data processing; parallel programming; public domain software; social networking (online); social sciences computing; Big Data; Hadoop platform; MapReduce-based method; large scale parallel computation; large-scale logistics network; logistics data; massive data; social network; social node structure; social relation extraction; Big data; Computers; Data mining; Logistics; Scalability; Social network services; Standards; MapReduce; big data; social network; social relation extraction;
Conference_Titel :
Systems, Man and Cybernetics (SMC), 2014 IEEE International Conference on
Conference_Location :
San Diego, CA
DOI :
10.1109/SMC.2014.6974264