• DocumentCode
    3489475
  • Title

    Key lessons in the efficient archive of small files to the CCLRC MSS using SRB

  • Author

    Strong, Brandon ; Corney, D.

  • Author_Institution
    CCLRC e-Sci., UK
  • fYear
    2005
  • fDate
    20-24 June 2005
  • Firstpage
    83
  • Lastpage
    87
  • Abstract
    High volume data projects within the CCLRC and the wider UK academic community (ISIS, BADC, and BBSRC) are increasingly looking to implement access to a "limitless" data archive through an SRB infrastructure. This paper describes the recent development of SRB containers as an efficient solution to the "small file problem", and the benefits this has brought to these scientific communities as it opens up high volume archives and mass storage systems as vital components of SRB-based data management infrastructures. By tracing the development of container implementation into the Atlas petabyte data store (based at CCLRC in the UK), across three specific projects (CMS, BBSRC and especially ISIS), the paper identifies and describes key lessons learned, both for CCLRC\´s particular projects and also for archival systems in general.
  • Keywords
    information retrieval systems; information storage; Atlas petabyte data store; content management system; data archive; data management infrastructure; integrated student information system; mass storage system; small file problem; storage resource broker; Collision mitigation; Computer architecture; Containers; History; Intersymbol interference; Performance analysis; Robots; Software development management; Throughput; Writing;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Local to Global Data Interoperability - Challenges and Technologies, 2005
  • Print_ISBN
    0-7803-9228-0
  • Type

    conf

  • DOI
    10.1109/LGDI.2005.1612471
  • Filename
    1612471