DocumentCode :
632863
Title :
Support for data-intensive computing with CloudMan
Author :
Kowsar, Yousef ; Afgan, Enis
Author_Institution :
Victorian Life Sci. Comput. Initiative (VLSCI), Univ. of Melbourne, Melbourne, VIC, Australia
fYear :
2013
fDate :
20-24 May 2013
Firstpage :
243
Lastpage :
248
Abstract :
Infrastructure-as-a-Service (IaaS) compute infrastructure model has showcased its ability to transform how access to compute resources is realized; it delivered on the notion of Infrastructure-as-Code and enabled a new wave of compute adaptability. In previous work we have been developing CloudMan (usecloudman.org) as a versatile solution for enabling and managing compute clusters in cloud environments via a simple web interface or an API. However, CloudMan only supported batch processing workloads. As the magnitude of the data produced and processed in digital form grows, the need to support big data applications in clusters in the cloud becomes more evident. In this paper, we have extended the batch processing capability of CloudMan and presenteda novel architecture for supporting big data analysis workloads in cluster-in-the-cloud environment. We also implemented the details through CloudMan using established big data platforms.
Keywords :
batch processing (computers); cloud computing; data analysis; API; CloudMan; Web interface; batch processing workloads; big data analysis workloads; cloud environments; cluster-in-the-cloud environment; computing adaptability; data-intensive computing; infrastructure-as-a-service; infrastructure-as-code; Bioinformatics; Cloud computing; Computer architecture; Data handling; Data storage systems; Engines; Information management;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Information & Communication Technology Electronics & Microelectronics (MIPRO), 2013 36th International Convention on
Conference_Location :
Opatija
Print_ISBN :
978-953-233-076-2
Type :
conf
Filename :
6596260
Link To Document :
بازگشت