DocumentCode
3777261
Title
Accommodate Apache YARN to long-lived services
Author
Huiyi Li; Ruonan Rao
Author_Institution
Software Engineering Department, Shanghai Jiao Tong University, China
Volume
1
fYear
2015
Firstpage
262
Lastpage
265
Abstract
Large-scale cluster scheduling and management systems are becoming a dominant platform for a variety of applications and services. These complex ?cloud? systems often run on clusters of thousands of unreliable commodity machines and mush handle all kinds of failures, schedule and deployment requirements while achieving the maximum resource utilization. We take YARN to a full analysis and argue that YARN currently excels in handling batch jobs without interacting with outside system or clients. In this paper, we propose a solution to the service registration, log management, resource reallocation problem of YARN and accommodate YARN to long-lived services.
Keywords
"Yarn","Containers","Resource management","Storms","Servers","Aggregates","Monitoring"
Publisher
ieee
Conference_Titel
Computer Science and Network Technology (ICCSNT), 2015 4th International Conference on
Type
conf
DOI
10.1109/ICCSNT.2015.7490748
Filename
7490748
Link To Document