Title :
Analysis of MapReduce scheduling and its improvements in cloud environment
Author :
D´Souza, Sofia ; Chandrasekaran, K.
Author_Institution :
Dept. of Math. & Comput. Sci., Nat. Inst. of Technol. Karnataka, Mangalore, India
Abstract :
MapReduce has become a prominent Parallel processing model used for analysing large scale data. MapReduce applications are increasingly being deployed in the cloud along with other applications sharing the same physical resources. In this scenario, efficient scheduling of MapReduce applications is of utmost importance. Also, MapReduce has to consider various other parameters like energy efficiency and meeting SLA goals besides achieving performance when executing jobs in cloud environments. In this work, we have classified MapReduce Scheduling as Cluster based Scheduling and Objective based Scheduling. We then summarize and analyse the different class of schedulers highlighting the strong points and limitations of each of the scheduling approaches. The Adaptive scheduling techniques provide dynamic resource management and meet performance goals. The Energy efficient scheduling techniques aim to cut data centre costs by using different approaches. Finally, we discuss the current challenges and future work.
Keywords :
cloud computing; energy conservation; parallel processing; power aware computing; scheduling; MapReduce scheduling; SLA goals; adaptive scheduling techniques; cloud environment; cluster based scheduling; dynamic resource management; energy efficiency; energy efficient scheduling techniques; objective based scheduling; parallel processing model; Adaptive scheduling; Cloud computing; Dynamic scheduling; Energy efficiency; Processor scheduling; Resource management; Cloud computing; Energy efficiency; Hadoop; MapReduce; Scheduling;
Conference_Titel :
Signal Processing, Informatics, Communication and Energy Systems (SPICES), 2015 IEEE International Conference on
Conference_Location :
Kozhikode
DOI :
10.1109/SPICES.2015.7091470