Title :
The Kangaroo approach to data movement on the Grid
Author :
Thain, Douglas ; Basney, Jim ; Son, Se-Chang ; Livny, Miron
Author_Institution :
Dept. of Comput. Sci., Wisconsin Univ., Madison, WI, USA
Abstract :
Access to remote data is one of the principal challenges of Grid computing. While performing I/O, Grid applications must be prepared for server crashes, performance variations and exhausted resources. To achieve high throughput in such a hostile environment, applications need a resilient service that moves data while hiding errors and latencies. We illustrate this idea with Kangaroo, a simple data movement system that makes opportunistic use of disks and networks to keep applications running. We demonstrate that Kangaroo can achieve better end-to-end performance than traditional data movement techniques, even though its individual components do not achieve high performance
Keywords :
data communication; distributed programming; performance evaluation; Grid computing; Kangaroo; computational grids; data movement system; end-to-end performance; error hiding; exhausted resources; hostile environment; latency hiding; opportunistic disk use; opportunistic network use; performance variations; resilient service; server crashes; throughput; Application software; Buffer storage; Computer crashes; Delay; File systems; Grid computing; Hardware; Joining processes; Operating systems; Throughput;
Conference_Titel :
High Performance Distributed Computing, 2001. Proceedings. 10th IEEE International Symposium on
Conference_Location :
San Francisco, CA
Print_ISBN :
0-7695-1296-8
DOI :
10.1109/HPDC.2001.945200