Title :
Highly Available Hadoop NameNode Architecture
Author :
Khan, Muhammad Asad ; Memon, Zubair Ahmed ; Khan, Sharifullah
Author_Institution :
Dept. of Comput. Sci., Sukkur Inst. of Bus. Adm. (SIBA), Sukkur, Pakistan
Abstract :
In past few years Hadoop Distributed File System (HDFS) has been used by many organizations with gigantic data sets and streams of operations on it. HDFS provides distinct features like, high fault tolerance, scalability, etc. The Name Node machine is a single point of failure (SPOF) for a HDFS cluster. If the Name Node machine fails, the system needs to be re-started manually, making the system less available. This paper proposes a highly available architecture and its working principle for the HDFS Name Node against its SPOF utilizing well-known 2-Phase Commit (2PC) Protocol and Election algorithm.
Keywords :
distributed databases; public domain software; software architecture; software fault tolerance; system recovery; 2-phase commit protocol; 2PC protocol; HDFS NameNode; HDFS cluster; Hadoop NameNode architecture; Hadoop distributed file system; NameNode machine; SPOF; election algorithm; fault tolerance; gigantic data set; single point of failure; system failure; 2PC protocol; Availability; Election by Bully; Fault Tolerance; HDFS; NameNode;
Conference_Titel :
Advanced Computer Science Applications and Technologies (ACSAT), 2012 International Conference on
Conference_Location :
Kuala Lumpur
Print_ISBN :
978-1-4673-5832-3
DOI :
10.1109/ACSAT.2012.52
