Title :
Real-time analysis in CMS Data Challenge 2004
Author :
Pierro, A. ; De Filippis, N. ; Donvito, G. ; Silvestris, L. ; Fanfani, A. ; Grandi, C. ; Hernández, J.M. ; Bonacorsi, D. ; Fanzago, F. ; Corvo, M.
Author_Institution :
Dipt. Interateneo di Fisica, Univ. e del Politecnico di Bari, Italy
Abstract :
During the CMS Data Challenge 2004 a real-time analysis was performed at INFN and PIC Tier-1 and Tier-2s in order to test the ability of the instrumented methods to quickly process the data. Several agents and automatic procedures were implemented to perform the analysis at the Tier-1/2 synchronously with the data transfer from Tier-0 at CERN. The system was implemented in the LCG-2 grid environment and allowed on-the-fly job preparation and subsequent submission to the resource broker as new data came along. Running job accessed data from the storage elements via remote file protocol, whenever possible, or copying them locally with replica manager commands. Details of the procedures adopted to run the analysis jobs and the expected results are described. An evaluation of the ability of the system to maintain an analysis rate at Tier-1 and Tier-2 comparable with the data transfer rate is also presented. The results on the analysis timeline, the statistics of submitted jobs, the overall efficiency of the GRID services and the overhead introduced by the agents/procedures are reported. Performances and possible bottlenecks of the whole procedure are discussed.
Keywords :
high energy physics instrumentation computing; CMS Data Challenge 2004; GRID services; LCG-2 grid environment; analysis jobs; analysis rate; analysis timeline; automatic procedures; data transfer rate; instrumented methods; real-time analysis; remote file protocol; replica manager commands; resource broker; running job; storage elements; Access protocols; Collision mitigation; Data analysis; Instruments; Large Hadron Collider; Performance analysis; Performance evaluation; Resonance light scattering; Statistical analysis; Testing;
Conference_Titel :
Nuclear Science Symposium Conference Record, 2004 IEEE
Conference_Location :
Rome
Print_ISBN :
0-7803-8700-7
Electronic_ISBN :
1082-3654
DOI :
10.1109/NSSMIC.2004.1462514