DocumentCode
2955454
Title
Non-POSIX file system for LHCb online event handling
Author
Garnier, J. ; Neufeld, N. ; Cherukuwada, S.S.
Author_Institution
CERN, Geneva, Switzerland
fYear
2010
fDate
24-28 May 2010
Firstpage
1
Lastpage
4
Abstract
LHCb aims to use its O(20000) CPU cores in the High Level Trigger (HLT) and its 120 TB Online storage system for data reprocessing during LHC shutdown periods. These periods can last a few days for technical maintenance or only a few hours during beam interfill gaps. These jobs run on files which are staged in from tape storage to the local storage buffer. The result are again one or more files. Efficient file writing and reading is essential for the performance of the system. Rather than using a traditional shared file-system such as NFS or CIFS we have implemented a custom, light-weight, non-Posix file-system for the handling of these files. Streaming this file-system for the data-access allows to obtain high performance, while at the same time keep the resource consumption low and add nice features not found in NFS such as high-availability, transparent fail-over of the read and write service. The writing part of this file-system is in successful use for the Online, real-time writing of the data during normal data acquisition operation. The implementation together with performance figures are presented.
Keywords
data handling; digital storage; file organisation; high energy physics instrumentation computing; CPU cores; HLT; High Level Trigger; LHC shutdown periods; LHCb online event handling; custom light weight file system; data reprocessing; file handling; file reading; file system streaming; file writing; local storage buffer; nonPOSIX file system; online storage system; tape storage; transparent fail over; File systems; Large Hadron Collider; Protocols; Servers; Storage area networks; Throughput; Writing; data acquisition; fail-over; file-system; high-availability;
fLanguage
English
Publisher
ieee
Conference_Titel
Real Time Conference (RT), 2010 17th IEEE-NPSS
Conference_Location
Lisbon
Print_ISBN
978-1-4244-7108-9
Type
conf
DOI
10.1109/RTC.2010.5750457
Filename
5750457
Link To Document