Title :
Distributed-memory parallel algorithms for generating massive scale-free networks using preferential attachment model
Author :
Alam, M. ; Khan, Mahrukh ; Marathe, Madhav V.
Author_Institution :
Dept. of Comput. Sci., Virginia Tech, Blacksburg, VA, USA
Abstract :
Recently, there has been substantial interest in the study of various random networks as mathematical models of complex systems. As these complex systems grow larger, the ability to generate progressively large random networks becomes all the more important. This motivates the need for efficient parallel algorithms for generating such networks. Naive parallelization of the sequential algorithms for generating random networks may not work due to the dependencies among the edges and the possibility of creating duplicate (parallel) edges. In this paper, we present MPI-based distributed memory parallel algorithms for generating random scale-free networks using the preferential-attachment model. Our algorithms scale very well to a large number of processors and provide almost linear speedups. The algorithms can generate scale-free networks with 50 billion edges in 123 seconds using 768 processors.
Keywords :
complex networks; distributed memory systems; parallel algorithms; random processes; MPI-based distributed memory parallel algorithms; Naive parallelization; complex systems; distributed-memory parallel algorithms; massive scale-free network generation; mathematical models; preferential attachment model; random scale-free networks; sequential algorithms; Abstracts; Algorithm design and analysis; Radio access networks; Big Data; copy model; high performance computing; parallel algorithms; preferential attachment; random networks; scale-free networks;
Conference_Titel :
High Performance Computing, Networking, Storage and Analysis (SC), 2013 International Conference for
Conference_Location :
Denver, CO
Print_ISBN :
978-1-4503-2378-9
DOI :
10.1145/2503210.2503291