ePubs
The open archive for STFC research publications
Home
About ePubs
Content Policies
News
Help
Privacy/Cookies
Suggest an Enhancement
Contact ePubs
Full Record Details
Persistent URL
http://purl.org/net/epubs/work/35505
Record Status
Checked
Record Id
35505
Title
Key lessons in the efficient archive of small files to the CCLRC MSS using SRB
Contributors
B Strong (CCLRC Rutherford Appleton Lab.)
,
DR Corney (CCLRC Rutherford Appleton Lab.)
,
P Berrisford (CCLRC Rutherford Appleton Lab.)
,
T Folkes (CCLRC Rutherford Appleton Lab.)
,
C Moreton-Smith (CCLRC Rutherford Appleton Lab.)
,
K Kleese van Dam (CCLRC Rutherford Appleton Lab.)
Abstract
High volume data projects within the CCLRC and the wider UK academic community (ISIS, BADC, and BBSRC) are increasingly looking to implement access to a "limitless" data archive through an SRB infrastructure. This paper describes the recent development of SRB containers as an efficient solution to the "small file problem", and the benefits this has brought to these scientific communities as it opens up high volume archives and Mass Storage Systems as vital components of SRB-based data management infrastructures. By tracing the development of container implementation into the Atlas Petabyte Data Store (based at CCLRC in the UK), across three specific projects (CMS, BBSRC and especially ISIS), the paper identifies and describes key lessons learned, both for CCLRC's particular projects and also for archival systems in general.
Organisation
CCLRC
,
ISIS
,
ESC
,
ISIS-ANA
,
ESC-DMG
Keywords
SRB
,
Data Storage
,
MSS
,
Mass Storage Systems
,
ISIS 2006
Funding Information
Related Research Object(s):
Licence Information:
Language
English (EN)
Type
Details
URI(s)
Local file(s)
Year
Paper In Conference Proceedings
In Symposium on "Data Interoperability - Challenges and Technologies", , Sardinia, (2005).
msst2005-sardinia-strong.pdf
2005
Showing record 1 of 1
Recent Additions
Browse Organisations
Browse Journals/Series
Login to add & manage publications and access information for OA publishing
Username:
Password:
Useful Links
Chadwick & RAL Libraries
SHERPA FACT
SHERPA RoMEO
SHERPA JULIET
Journal Checker Tool
Google Scholar