Performances of Different Schedulers in YARN and Their Effects on Hadoop HaOLAP

Performances of Different Schedulers in YARN and Their Effects on Hadoop HaOLAP

This study investigates the effects of the YARN on the HaOLAP Hadoop and tries to assess how different types of schedulers of the YARN can be used to achieve the optimum result to improve the performance of the HaOLAP Hadoop. In the first step, HaOLAP Hadoop v.1.0 is compared with HaOLAP Hadoop v.3.2.1 augmented with YARN, and all three major schedulers namely FIFO, Fair, and Capacity are separately used and their effects on execution time are evaluated. Accordingly, three collections of data called C_1, C_2, and C_3 containing 〖10〗^5, 〖10〗^6, and 〖10〗^7 items respectively from medical clinic records are selected and evaluated under three operations A_1, A_2, and A_3. In the second step performance of the schedulers is compared and their cons and pros are assessed. Finally, some suggestions to achieve the optimum results to augment HaOLAP Hadoop with YARN are presented based on this study’s results.