Title :
A scalable eigensolver for large scale-free graphs using 2D graph partitioning
Author :
Yoo, Andy ; Baker, Allison H. ; Pearce, Roger ; Henson, Van Emden
Author_Institution :
Center for Appl. Sci. Comput., Lawrence Livermore Nat. Lab., Lawrence, CA, USA
Abstract :
Eigensolvers are important tools for analyzing and mining useful information from scale-free graphs. Such graphs are used in many applications and can be extremely large. Unfortunately, existing parallel eigensolvers do not scale well for these graphs due to the high communication overhead in the parallel matrix-vector multiplication (MatVec). We develop a MatVec algorithm based on 2D edge partitioning that significantly reduces the communication costs and embed it into a popular eigensolver library. We demonstrate that the enhanced eigensolver can attain two orders of magnitude performance improvement compared to the original on a state-of-art massively parallel machine. We illustrate the performance of the embedded MatVec by computing eigenvalues of a scale-free graph with 300 million vertices and 5 billion edges, the largest scale-free graph analyzed by any in-memory parallel eigensolver, to the best of our knowledge.
Keywords :
data analysis; data mining; eigenvalues and eigenfunctions; graph theory; matrix multiplication; vectors; 2D edge partitioning; 2D graph partitioning; MatVec algorithm; information analysis; information mining; large scale-free graphs; parallel machine; parallel matrix-vector multiplication; scalable eigensolver; Generators; Libraries; Partitioning algorithms; Program processors; Scalability; Sparse matrices; Vectors;
Conference_Titel :
High Performance Computing, Networking, Storage and Analysis (SC), 2011 International Conference for
Conference_Location :
Seatle, WA
Electronic_ISBN :
978-1-4503-0771-0