DocumentCode
736899
Title
Load Balancing Task Scheduling Algorithm in Hadoop Platform
Author
Yandong, Cai ; Yan, Liu ; Qinglei, Zhang
fYear
2015
fDate
13-14 June 2015
Firstpage
605
Lastpage
608
Abstract
As the cloud platform, it must be the platform with high performance, high reliability, easy expanding, but if only by constantly updating the server to realize the cloud platform, it will undoubtedly exist the following problems: 1, the update of server causes the waste of hardware, 2, the cost of many high performance server as backup is too high, 3, the general design often has network bottleneck, making the performance not play out. The design of this paper using cluster technology of load balanced, to realize the cloud platform reconciling credibility, performance and cost. The network structure that combining the ring network and star network, diversifies the combining form of computation, it also can improve the performance, and the multiple use of load balancing and backup makes performance and safety be reflected. The load balancing technology with consideration of the bottleneck problem of network, makes customer´s visit will not only focus on a certain endpoints, which makes the communication process will not meet the bottleneck. Finally, through the analysis of the reliability and performance and the test of the practical application, we found that the performance of the design was better in the case of higher load, and the platform could maintain this state for long term.
Keywords
Databases; Load management; Reliability engineering; Web servers; Ring and star network; database level and vertical segmentation; distributed computing; horizontal load balancing; pipelined computing; vertical load balancing;
fLanguage
English
Publisher
ieee
Conference_Titel
Measuring Technology and Mechatronics Automation (ICMTMA), 2015 Seventh International Conference on
Conference_Location
Nanchang, China
Print_ISBN
978-1-4673-7142-1
Type
conf
DOI
10.1109/ICMTMA.2015.152
Filename
7263646
Link To Document