Title :
Application research of Hadoop resource monitoring system based on Ganglia and Nagios
Author :
Mingli Wu ; Zhongmei Zhang ; Yebai Li
Author_Institution :
Sch. of Inf. Eng., North China Univ. of Technol., Beijing, China
Abstract :
As an open source software platform, Hadoop has been applied widely. Aim at the need of Hadoop resource monitoring, this paper introduces Hadoop and two distributed monitoring systems, which are Ganglia and Nagios. We design a resource monitoring system of Hadoop, which can monitor Hadoop comprehensively, and provide real-time monitoring, warning messages and reports. It makes use of the advantages of Ganglia and Nagios, and resolves the problem that Ganglia can´t store data permanently. Finally, an effective solution is provided for resource monitoring of Hadoop.
Keywords :
distributed processing; public domain software; real-time systems; storage management; Ganglia; Hadoop resource monitoring system; Nagios; data storage; distributed monitoring systems; open source software platform; real-time monitoring; warning messages; Decision making; Monitoring; Ganglia; Hadoop; Nagios; Resource Monitoring;
Conference_Titel :
Software Engineering and Service Science (ICSESS), 2013 4th IEEE International Conference on
Conference_Location :
Beijing
Print_ISBN :
978-1-4673-4997-0
DOI :
10.1109/ICSESS.2013.6615399