12-16 October 2015
Brookhaven National Laboratory
America/New_York timezone

Ceph object storage at RAL

14 Oct 2015, 16:30
20m
Bldg. 510 - Physics Department Large Seminar Room (Brookhaven National Laboratory)

Bldg. 510 - Physics Department Large Seminar Room

Brookhaven National Laboratory

Upton, NY 11973
Storage & Filesystems Storage and Filesystems

Speaker

George Vasilakakos (STFC)

Description

RAL is currently developing storage services powered by a Ceph object storage system. We review the test results and experiences of the newly-installed 5 PB cluster at RAL, as well as our plans for it. Since the aim is to provide large scale storage for experimental data with minimal space overhead, we focus on testing a variety of erasure coding techniques and schemes. We look at functionality and performance testing of XrootD and GridFTP servers that have been adapted to use a Ceph backend, as well as, RADOS gateways providing an S3-compatible interface. We also look at the effects of erasure coding on the stability and resiliency of a highly distributed system at this scale.
Length of presentation (max. 20 minutes) 20

Primary author

Co-authors

Alastair Dewhurst (STFC - Rutherford Appleton Lab. (GB)) Bruno Canning (RAL) Mr Ignacy Debicki (STFC RAL) James Adams (STFC RAL) Shaun de Witt (STFC)

Presentation Materials