Title :
Priority Scheduling in MapReduce Based on Queuing Theory
Author :
Cong Wan ; Cuirong Wang ; Shuo Jia
Author_Institution :
Coll. of Inf. Sci. & Eng., Northeastern Univ., Shenyang, China
Abstract :
MapReduce is a programming model and an associated implementation for processing and generating large data sets. Providing MapReduce as a service is the development future trend. This paper present a queue theory based scheduling scheme for MapReduce framework. The scheme divides users into priority user and non-priority and users respectively corresponding to different queues. The scheme insures priority user has a pre-specified delay and the non-priority queue have a promised utilization ratio. At last, Experiments show the effectiveness of the scheme.
Keywords :
distributed processing; queueing theory; scheduling; MapReduce; nonpriority queue; nonpriority user; prespecified delay; priority scheduling; programming model; queue theory based scheduling scheme; queuing theory; Computational modeling; Delays; Dynamic scheduling; Processor scheduling; Programming; Queueing analysis; MapReduce; Priority; Queuing Theory; Scheduling;
Conference_Titel :
Instrumentation, Measurement, Computer, Communication and Control (IMCCC), 2013 Third International Conference on
Conference_Location :
Shenyang
DOI :
10.1109/IMCCC.2013.98