Title :
BReW: Blackbox resource selection for e-Science workflows
Author :
Simmhan, Y. ; Soroush, E. ; van Ingen, C. ; Agarwal, D. ; Ramakrishnan, L.
Author_Institution :
Comput. Eng. Div., Univ. of Southern California, Los Angeles, CA, USA
Abstract :
Workflows are commonly used to model data intensive scientific analysis. As computational resource needs increase for eScience, emerging platforms like clouds present additional resource choices for scientists and policy makers. We introduce BReW, a tool enables users to make rapid, highlevel platform selection for their workflows using limited workflow knowledge. This helps make informed decisions on whether to port a workflow to a new platform. Our analysis of synthetic and real eScience workflows shows that using just total runtime length, maximum task fanout, and total data used and produced by the workflow, BReW can provide platform predictions comparable to whitebox models with detailed workflow knowledge.
Keywords :
cloud computing; data analysis; natural sciences computing; workflow management software; BReW; blackbox resource selection; clouds; data intensive scientific analysis; e-science workflows; Analytical models; Availability; Clouds; Data models; Predictive models; Runtime; Workstations; HPC; cloud; planning; resource platforms; resource selection; workflow; workflow migration;
Conference_Titel :
Workflows in Support of Large-Scale Science (WORKS), 2010 5th Workshop on
Conference_Location :
New Orleans, LA
Print_ISBN :
978-1-4244-8989-3
DOI :
10.1109/WORKS.2010.5671857