DocumentCode
2028904
Title
Subordination: Cluster management without distributed consensus
Author
Gankevich, Ivan ; Tipikin, Yuri ; Gaiduchok, Vladimir
Author_Institution
Dept. of Comput. Modeling & Multiprocessor Syst., St. Petersburg State Univ., St. Petersburg, Russia
fYear
2015
fDate
20-24 July 2015
Firstpage
639
Lastpage
642
Abstract
Nowadays, many cluster management systems rely on distributed consensus algorithms to elect a leader that orchestrates subordinate nodes. Contrary to these studies we propose consensus-free algorithm that arranges cluster nodes into multiple levels of subordination. The algorithm structures IP address range of cluster network so that each node has ranked list of candidates, from which it chooses a leader. The results show that this approach easily scales to a large number of nodes due to its asynchronous nature, and enables fast recovery from node failures as they occur only on one level of hierarchy. Multiple levels of subordination are useful for efficiently collecting monitoring and accounting data from large number of nodes, and for scheduling general-purpose tasks on a cluster.
Keywords
processor scheduling; workstation clusters; IP address; accounting data; cluster management systems; cluster nodes; consensus-free algorithm; distributed consensus algorithms; general-purpose task scheduling; node failures; subordinate nodes; subordination; Clustering algorithms; Computers; Heuristic algorithms; IP networks; Network topology; Nominations and elections; Topology; cluster accounting; cluster management; cluster monitoring; job scheduling; leader election;
fLanguage
English
Publisher
ieee
Conference_Titel
High Performance Computing & Simulation (HPCS), 2015 International Conference on
Conference_Location
Amsterdam
Print_ISBN
978-1-4673-7812-3
Type
conf
DOI
10.1109/HPCSim.2015.7237106
Filename
7237106
Link To Document