Mar 23 – 27, 2015
Physics Department, Oxford University
Europe/London timezone

Status Report on Ceph Based Storage Systems at the RACF

Mar 25, 2015, 11:55 AM
Martin Wood Lecture Theatre, Parks Road (Physics Department, Oxford University)

Martin Wood Lecture Theatre, Parks Road

Physics Department, Oxford University

Storage & Filesystems Storage and File Systems




We review various functionality, performance, and stability tests performed at the RHIC and ATLAS Computing Facility (RACF) at Brookhaven National Laboratory (BNL) in 2014-2015. Tests were run on all three (object storage, block storage and file system) levels of Ceph, using a range of hardware platforms and networking solutions, including 10/40 Gbps Ethernet and IPoIB/4X FDR Infiniband. We also report the current status of a 1 PB scale Ceph-based object storage system, provided with Amazon S3 compliant RADOS Gateway interfaces, that was built for the RACF in 2014 and went through a major hardware upgrade in the beginning of 2015. We present performance measurements of this system and discuss the experience gained while operating it as ATLAS event service storage for the past 8 months.

Primary authors

Mr Alexandr Zaytsev (Brookhaven National Laboratory (US)) Hironori Ito (Brookhaven National Laboratory (US)) Dr Ofer Rind (BROOKHAVEN NATIONAL LABORATORY)


Antonio Wong (Brookhaven National Laboratory (US)) Christopher Hollowell (Brookhaven National Laboratory) Mr Tejas Rao (Brookhaven National Laboratory (US))

Presentation materials