Speaker
George Vasilakakos
(STFC)
Description
RAL is currently developing storage services powered by a Ceph object storage system. We review the test results and experiences of the newly-installed 5 PB cluster at RAL, as well as our plans for it. Since the aim is to provide large scale storage for experimental data with minimal space overhead, we focus on testing a variety of erasure coding techniques and schemes. We look at functionality and performance testing of XrootD and GridFTP servers that have been adapted to use a Ceph backend, as well as, RADOS gateways providing an S3-compatible interface. We also look at the effects of erasure coding on the stability and resiliency of a highly distributed system at this scale.
| Length of presentation (max. 20 minutes) | 20 |
|---|
Primary author
George Vasilakakos
(STFC)
Co-authors
Alastair Dewhurst
(STFC - Rutherford Appleton Lab. (GB))
Bruno Canning
(RAL)
Mr
Ignacy Debicki
(STFC RAL)
James Adams
(STFC RAL)
Shaun de Witt
(STFC)
