DocumentCode :
183094
Title :
Implementation of a parallel graph partition algorithm to speed up BSP computing
Author :
Shengmei Luo ; Lixia Liu ; Hongxu Wang ; Bin Wu ; Yang Liu
Author_Institution :
Dept. of Comput. Sci. & Technol., Tsinghua Univ., Beijing, China
fYear :
2014
fDate :
19-21 Aug. 2014
Firstpage :
740
Lastpage :
744
Abstract :
The processing and mining information in large scale graph data have proven to be challenging. The bulk synchronous parallel (BSP) computing model is suitable for this task. In this paper, we implement the multi-level step-wise partitioning (MSP) algorithm in BSP programming model, and replace the original graph partition method. The results on both experimental data and real world data proved this improvement achieved better data locality, reduced communication between work nodes, and it made a better performance than the original method.
Keywords :
data mining; graph theory; parallel processing; BSP computing; BSP programming model; MSP algorithm; bulk synchronous parallel computing model; communication reduction; data locality; information mining; information processing; large-scale graph data; multilevel step-wise partitioning algorithm; parallel graph partition algorithm implementation; work nodes; Algorithm design and analysis; Communities; Computational modeling; Computers; Engines; Parallel processing; Partitioning algorithms; BSP; HAMA; MapReduce; complex network; graph partition;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Fuzzy Systems and Knowledge Discovery (FSKD), 2014 11th International Conference on
Conference_Location :
Xiamen
Print_ISBN :
978-1-4799-5147-5
Type :
conf
DOI :
10.1109/FSKD.2014.6980928
Filename :
6980928
Link To Document :
بازگشت