An overview of a large-scale data migration

Author

Lübeck, Magnus ; Geppert, D. ; Nienartowicz, Krzysztof

fYear

2003

fDate

7-10 April 2003

Firstpage

49

Lastpage

55

Abstract

We present an overview of the migration of the data collected by the COMPASS experiment at CERN. In less than three months, almost 300 TB will be migrated at a sustained data rate approaching 100 MB/s, using a distributed system with multiple nodes and data servers. This project, which is being carried out by the Database Group of CERN´s IT Division and is expected to be completed by early 2003, involves both a physical media migration, from StorageTek 9940A to StorageTek 9940B tapes, and a data format conversion, from an object database management system to a hybrid persistency mechanism based on flat files referenced in a relational database management system.

Keywords

electronic data interchange; high energy physics instrumentation computing; relational databases; CERN; COMPASS experiment; StorageTek 9940A tapes; StorageTek 9940B tapes; data format conversion; distributed system; flat files; hybrid persistency mechanism; large-scale data migration; multiple data servers; multiple nodes; object database management system; physical media migration; relational database management system; Database systems; Elementary particles; Energy measurement; Information retrieval; Large-scale systems; Memory; Navigation; Particle beams; Project management; Relational databases;

fLanguage

English

Publisher

ieee

Conference_Titel

Mass Storage Systems and Technologies, 2003. (MSST 2003). Proceedings. 20th IEEE/11th NASA Goddard Conference on

Print_ISBN

0-7695-1914-8

Type

conf

DOI

10.1109/MASS.2003.1194835

Filename

1194835