12-16 October 2015
Brookhaven National Laboratory
America/New_York timezone

Ceph object storage at RAL

14 Oct 2015, 16:30
20m
Bldg. 510 - Physics Department Large Seminar Room (Brookhaven National Laboratory)

Bldg. 510 - Physics Department Large Seminar Room

Brookhaven National Laboratory

Upton, NY 11973
Storage & Filesystems Storage and Filesystems

Speaker

George Vasilakakos (STFC)

Description

RAL is currently developing storage services powered by a Ceph object storage system. We review the test results and experiences of the newly-installed 5 PB cluster at RAL, as well as our plans for it. Since the aim is to provide large scale storage for experimental data with minimal space overhead, we focus on testing a variety of erasure coding techniques and schemes. We look at functionality and performance testing of XrootD and GridFTP servers that have been adapted to use a Ceph backend, as well as, RADOS gateways providing an S3-compatible interface. We also look at the effects of erasure coding on the stability and resiliency of a highly distributed system at this scale.
Length of presentation (max. 20 minutes) 20

Primary author

Co-authors

Alastair Dewhurst (STFC - Rutherford Appleton Lab. (GB)) Bruno Canning (RAL) Mr Ignacy Debicki (STFC RAL) James Adams (STFC RAL) Shaun de Witt (STFC)

Presentation Materials

Your browser is out of date!

If you are using Internet Explorer, please use Firefox, Chrome or Edge instead.

Otherwise, please update your browser to the latest version to use Indico without problems.

×