Title :
Implementation of a parallel graph partition algorithm to speed up BSP computing
Author :
Shengmei Luo ; Lixia Liu ; Hongxu Wang ; Bin Wu ; Yang Liu
Author_Institution :
Dept. of Comput. Sci. & Technol., Tsinghua Univ., Beijing, China
Abstract :
The processing and mining information in large scale graph data have proven to be challenging. The bulk synchronous parallel (BSP) computing model is suitable for this task. In this paper, we implement the multi-level step-wise partitioning (MSP) algorithm in BSP programming model, and replace the original graph partition method. The results on both experimental data and real world data proved this improvement achieved better data locality, reduced communication between work nodes, and it made a better performance than the original method.
Keywords :
data mining; graph theory; parallel processing; BSP computing; BSP programming model; MSP algorithm; bulk synchronous parallel computing model; communication reduction; data locality; information mining; information processing; large-scale graph data; multilevel step-wise partitioning algorithm; parallel graph partition algorithm implementation; work nodes; Algorithm design and analysis; Communities; Computational modeling; Computers; Engines; Parallel processing; Partitioning algorithms; BSP; HAMA; MapReduce; complex network; graph partition;
Conference_Titel :
Fuzzy Systems and Knowledge Discovery (FSKD), 2014 11th International Conference on
Conference_Location :
Xiamen
Print_ISBN :
978-1-4799-5147-5
DOI :
10.1109/FSKD.2014.6980928