• DocumentCode
    1475803
  • Title

    Non-POSIX File System for LHCb Online Event Handling

  • Author

    Garnier, Jean-Christophe ; Neufeld, Niko ; Cherukuwada, S.S.

  • Author_Institution
    CERN, Geneva, Switzerland
  • Volume
    58
  • Issue
    4
  • fYear
    2011
  • Firstpage
    1872
  • Lastpage
    1876
  • Abstract
    LHCb aims to use its O(20000) CPU cores in the high level trigger (HLT) and its 120 TB Online storage system for data reprocessing during LHC shutdown periods. These periods can last a few days for technical maintenance or only a few hours during beam interfill gaps. These jobs run on files which are staged in from tape storage to the local storage buffer. The result are again one or more files. Efficient file writing and reading is essential for the performance of the system. Rather than using a traditional shared file-system such as NFS or CIFS we have implemented a custom, light-weight, non-Posix network file-system for the handling of these files. Streaming this file-system for the data-access allows to obtain high performance, while at the same time keep the resource consumption low and add nice features not found in NFS such as high-availability, transparent fail-over of the read and write service. The writing part of this streaming service is in successful use for the Online, real-time writing of the data during normal data acquisition operation. The network file system relies on a commercial file system which manages the data on persistent disk storage. The implementation together with performance figures are presented.
  • Keywords
    data acquisition; high energy physics instrumentation computing; storage area networks; storage management; CPU cores; LHCb online event handling; TB Online storage system; beam intertill gaps; data acquisition operation; data reprocessing; file-system; high level trigger; nonPOSIX file system; streaming service; Data acquisition; Large Hadron Collider; Protocols; Servers; Storage area networks; Throughput; Writing; Data acquisition; fail-over; high-availability; network file-system;
  • fLanguage
    English
  • Journal_Title
    Nuclear Science, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9499
  • Type

    jour

  • DOI
    10.1109/TNS.2011.2116804
  • Filename
    5734878