DocumentCode
3104748
Title
Adaptive Parallel Graph Mining for CMP Architectures
Author
Buehrer, Gregory ; Parthasarathy, Srinivasan ; Chen, Yen-Kuang
Author_Institution
Dept. of Comput. Sci. & Eng., Ohio State Univ., Columbus, OH
fYear
2006
fDate
18-22 Dec. 2006
Firstpage
97
Lastpage
106
Abstract
Mining graph data is an increasingly popular challenge, which has practical applications in many areas, including molecular substructure discovery, Web link analysis, fraud detection, and social network analysis. The problem statement is to enumerate all subgraphs occurring in at least sigma graphs of a database, where sigma is a user specified parameter. Chip multiprocessors (CMPs) provide true parallel processing, and are expected to become the de facto standard for commodity computing. In this work, building on the state-of-the-art, we propose an efficient approach to parallelize such algorithms for CMPs. We show that an algorithm which adapts its behavior based on the runtime state of the system can improve system utilization and lower execution times. Most notably, we incorporate dynamic state management to allow memory consumption to vary based on availability. We evaluate our techniques on current day shared memory systems (SMPs) and expect similar performance for CMPs. We demonstrate excellent speedup, 27-fold on 32 processors for several real world datasets. Additionally, we show our dynamic techniques afford this scalability while consuming up to 35% less memory than static techniques.
Keywords
data mining; microprocessor chips; parallel processing; CMP architectures; adaptive parallel graph mining; chip multiprocessors; dynamic state management; parallel processing; shared memory systems; Chemicals; Computer architecture; Concurrent computing; Data mining; Memory management; Parallel processing; Personal communication networks; Runtime; Social network services; Yarn;
fLanguage
English
Publisher
ieee
Conference_Titel
Data Mining, 2006. ICDM '06. Sixth International Conference on
Conference_Location
Hong Kong
ISSN
1550-4786
Print_ISBN
0-7695-2701-7
Type
conf
DOI
10.1109/ICDM.2006.15
Filename
4053038
Link To Document