Title :
Catch the Wind: Graph workload balancing on cloud
Author :
Zechao Shang ; Yu, Jeffrey Xu
Author_Institution :
Chinese Univ. of Hong Kong, Hong Kong, China
Abstract :
Graph partitioning is a key issue in graph database processing systems for achieving high efficiency on Cloud. However, the balanced graph partitioning itself is difficult because it is known to be NP-complete. In addition a static graph partitioning cannot keep all graph algorithms efficient for a long time in parallel on Cloud because the workload balancing in different iterations for different graph algorithms are all possible different. In this paper, we investigate graph behaviors by exploring the working window (we call it wind) changes, where a working window is a set of active vertices that a graph algorithm really needs to access in parallel computing. We investigated nine classic graph algorithms using real datasets, and propose simple yet effective policies that can achieve both high graph workload balancing and efficient partition on Cloud.
Keywords :
cloud computing; optimisation; NP-complete; balanced graph partitioning; cloud; graph algorithm; graph behaviors; graph database processing system; high graph workload balancing; parallel computing; static graph partitioning; Algorithm design and analysis; Computational modeling; Google; Minimization; Nickel; Partitioning algorithms; Synchronization;
Conference_Titel :
Data Engineering (ICDE), 2013 IEEE 29th International Conference on
Conference_Location :
Brisbane, QLD
Print_ISBN :
978-1-4673-4909-3
Electronic_ISBN :
1063-6382
DOI :
10.1109/ICDE.2013.6544855