Title :
An instances placement algorithm based on disk I/O load for big data in private cloud
Author :
Jian Guo ; Zhao-Meng Zhu ; Xiu-Min Zhou ; Gong-Xuan Zhang
Author_Institution :
Dept. of Comput. Sci., Nanjing Univ. of Sci. & Technol., Nanjing, China
Abstract :
In generally, large companies or organizations have the demand of big data processing and they do not want to entrust their business processes and data to third parties (Amazon, Google, etc.). The private cloud could meet their needs. In private cloud, tasks run at multiple instances (also known as virtual machines), which could be paced in different physical nodes. Obviously, the instances which be used to process big data need higher CPU and disk performance than other kinds of instances. If the instances of disk resource consuming are placed in the same physical node, clearly, the disk I/O bandwidth would be used up quickly that would affect the performance of the entire node seriously. This paper proposes an instances placement algorithm FFDL that based on disk I/O for private cloud environment to deal with big data that would adopt the disk I/O load balancing strategy and reduce competition for the disk I/O load between instances. We have validated our approach by conducting a performance evaluation study on the open source private cloud platform-Openstack. The results demonstrate that our algorithm has immense potential as it offers significant computation time savings than the Greedy algorithm and demonstrates high potential for the improvement of disk I/O load balancing in the entire private cloud system for the big data.
Keywords :
cloud computing; data handling; public domain software; resource allocation; software performance evaluation; virtual machines; FFDL algorithm; Openstack platform; big data processing; computation time savings; disk I/O bandwidth; disk I/O load balancing; disk resource consuming instances; instances placement algorithm; open source private cloud platform; performance evaluation; physical nodes; private cloud environment; virtual machines; Abstracts; Data handling; Data storage systems; Information management; Runtime; Big Data; Disk I/O load balancing; Instances placement; Openstack; Private cloud;
Conference_Titel :
Wavelet Active Media Technology and Information Processing (ICWAMTIP), 2012 International Conference on
Conference_Location :
Chengdu
Print_ISBN :
978-1-4673-1684-2
DOI :
10.1109/ICWAMTIP.2012.6413495