Title :
Managing and serving a multiterabyte data set at the Fermilab DØ experiment
Author_Institution :
Fermi Nat. Accel. Lab., Batavia, IL, USA
Abstract :
The DØ experiment at Fermilab is accumulating data from the electronic detection of collisions between protons and anti-protons. The presentation describes the data structure, data cataloging and serving of the multiterabyte data set to a user community. The current data consists of over 85 terabytes stored in a hierarchy of data sets with various latencies and frequencies of use. The primary data storage is on some 40,000 8-mm tapes while the most frequently used data is on nearly 300 Gigabytes of SCSI disks. Data is served to VMS and UNIX analysis clusters over an FDDI network from a centralized file server. We also describe plans for handling a future data set anticipated to be an order of magnitude larger. Some of the ideas being considered are alternative data structures, parallel disk access, automated tape libraries, and centralized analysis servers
Keywords :
FDDI; data acquisition; data structures; file servers; high energy physics instrumentation computing; magnetic tape storage; physics computing; proton-proton interactions; storage management; 300 Gbyte; 85 Tbyte; FDDI network; Fermilab DO experiment; SCSI disk; UNIX analysis clusters; VMS analysis clusters; automated tape libraries; centralized analysis servers; centralized file server; data cataloging; data handling; data set hierarchy; data storage; data structure; electronic collision detection; latencies; multiterabyte data set management; multiterabyte data set serving; parallel disk access; proton-antiproton collisions; use frequencies; user community; Data structures; Delay; FDDI; File servers; Frequency; Libraries; Memory; Network servers; Protons; Voice mail;
Conference_Titel :
Mass Storage Systems, 1995. 'Storage - At the Forefront of Information Infrastructures', Proceedings of the Fourteenth IEEE Symposium on
Conference_Location :
Monterey, CA
Print_ISBN :
0-8186-7064-9
DOI :
10.1109/MASS.1995.528230
