17 September 2019
CERN
Europe/Zurich timezone

Ceph Supporting Genetic Research at The Wellcome Sanger Institute

17 Sept 2019, 11:00
25m
500/1-001 - Main Auditorium (CERN)

500/1-001 - Main Auditorium

CERN

46.232615, 6.045141
400
Show room on map

Speaker

Dr Matthew Vernon (Wellcome Sanger Institute)

Description

The Wellcome Sanger Institute has 18PB in its largest Ceph cluster. This talk will explain how the Sanger used Ceph to build and scale a reliable platform for scientific computing, and enable secure data sharing via S3. And how they got 100GB/s read performance out of their cluster.

Matthew will outline the interesting aspects of the Sanger's Ceph setup, including how the team grew it from a small initial installation, automated deployment management and monitoring, and some of the issues they have encountered along the way. Matthew will also explore some of the good (and less good!) aspects of running Ceph at scale, and supporting scientific workflows.

Primary author

Dr Matthew Vernon (Wellcome Sanger Institute)

Presentation materials