The Fermilab data storage infrastructure

Author

Bakken, Jon ; Berman, Eileen ; Huang, Chih-Hao ; Moibenko, Alexander ; Petravick, Donald ; Zalokar, Michael

Author_Institution

Fermi Nat. Accel. Lab., USA

fYear

2003

fDate

7-10 April 2003

Firstpage

101

Lastpage

104

Abstract

Fermilab, in collaboration with the DESY laboratory in Hamburg, Germany, has created a petabyte scale data storage infrastructure to meet the requirements of experiments to store and access large data sets. The Fermilab data storage infrastructure consists of the following major storage and data transfer components: the Enstore mass storage system, DCache distributed data cache, FTP and grid FTP for primarily external data transfers. This infrastructure provides a data throughput sufficient for transferring data from experimental data acquisition systems. It also allows access to data in the grid framework.

Keywords

cache storage; distributed processing; electronic data interchange; physics computing; storage management; DCache distributed data cache; DESY laboratory; Enstore mass storage system; Fermi National Accelerator Laboratory; Fermilab; data throughput; data transfer components; data transfers; petabyte scale data storage infrastructure; Cache storage; Data acquisition; File servers; Hardware; Laboratories; Memory; Power system reliability; Robots; Software libraries; Throughput;

fLanguage

English

Publisher

ieee

Conference_Titel

Mass Storage Systems and Technologies, 2003. (MSST 2003). Proceedings. 20th IEEE/11th NASA Goddard Conference on

Print_ISBN

0-7695-1914-8

Type

conf

DOI

10.1109/MASS.2003.1194845

Filename

1194845