• DocumentCode
    3777261
  • Title

    Accommodate Apache YARN to long-lived services

  • Author

    Huiyi Li; Ruonan Rao

  • Author_Institution
    Software Engineering Department, Shanghai Jiao Tong University, China
  • Volume
    1
  • fYear
    2015
  • Firstpage
    262
  • Lastpage
    265
  • Abstract
    Large-scale cluster scheduling and management systems are becoming a dominant platform for a variety of applications and services. These complex ?cloud? systems often run on clusters of thousands of unreliable commodity machines and mush handle all kinds of failures, schedule and deployment requirements while achieving the maximum resource utilization. We take YARN to a full analysis and argue that YARN currently excels in handling batch jobs without interacting with outside system or clients. In this paper, we propose a solution to the service registration, log management, resource reallocation problem of YARN and accommodate YARN to long-lived services.
  • Keywords
    "Yarn","Containers","Resource management","Storms","Servers","Aggregates","Monitoring"
  • Publisher
    ieee
  • Conference_Titel
    Computer Science and Network Technology (ICCSNT), 2015 4th International Conference on
  • Type

    conf

  • DOI
    10.1109/ICCSNT.2015.7490748
  • Filename
    7490748