17 September 2019
CERN
Europe/Zurich timezone

Utilising Ceph for large scale, high throughput storage to support the LHC experiments

17 Sept 2019, 16:00
25m
500/1-001 - Main Auditorium (CERN)

500/1-001 - Main Auditorium

CERN

46.232615, 6.045141
400
Show room on map

Speaker

Tom Byrne (STFC)

Description

Our large erasure coded ceph cluster is used by the four large LHC experiments for scientific data storage, providing 30PB of usable storage and averaging a 30GB/s read rate to the analysis cluster. In this talk I will talk about the architecture of the system, and how we have optimised it to allow us to reliably support a large transfer rate. I will also discuss some of the issues, and solutions, surrounding transfer performance monitoring in our architecture.

Author

Tom Byrne (STFC)

Presentation materials