Title :
Fast scalable file distribution over Infiniband
Author :
Dalessandro, Dennis ; Wyckoff, Pete
Author_Institution :
Ohio Supercomput. Center, USA
Abstract :
One of the first steps in starting a program on a cluster is to get the executable, which generally resides on some network file server. This creates not only contention on the network, but causes unnecessary strain on the network file system as well, which is busy serving other requests at the same time. This approach is certainly not scalable, as clusters grow larger. We present a new approach that uses a high speed interconnect, novel network features, and a scalable design. We provide a fast, efficient, and scalable solution to the distribution of executable files on production parallel machines.
Keywords :
file organisation; parallel machines; peer-to-peer computing; Infiniband; high speed interconnect; network file server; network file system; parallel machines; remote direct memory access; scalable file distribution; Capacitive sensors; File servers; File systems; Message passing; Network servers; Parallel machines; Peer to peer computing; Production; Supercomputers; Telecommunication traffic; Cluster; File system; Infiniband; RDMA; Scalable File Distribution;
Conference_Titel :
Parallel and Distributed Processing Symposium, 2005. Proceedings. 19th IEEE International
Print_ISBN :
0-7695-2312-9
DOI :
10.1109/IPDPS.2005.222