Oct 13 – 17, 2014
University of Nebraska - Lincoln
America/Chicago timezone

Ceph Based Storage Systems for RACF

Oct 16, 2014, 10:00 AM
Nebraska Union - Regency Suite (University of Nebraska - Lincoln)

Nebraska Union - Regency Suite

University of Nebraska - Lincoln

<b>GPS coordinates :</b> <a href="https://www.google.com/maps/place/Nebraska+Union/@40.8177945,-96.7004067,17z"> N 40.81 E -96.70 </a>
Storage & Filesystems Storage and Filesystems


Mr Alexandr Zaytsev (Brookhaven National Laboratory (US))


Ceph based storage solutions are becoming increasingly popular within the HEP/NP community over the last few years. With the current status of Ceph project, both object storage and block storage layers are production ready on a large scale, and the Ceph file system storage layer (CephFS) is rapidly getting to that state as well. This contribution contains a thorough review of various functionality, performance and stability tests performed with all three (object storage, block storage and file system) levels of Ceph by using the RACF computing resources in 2012-2014 on various hardware platforms (including HP Moonshot) and with different networking solutions (10/40 GbE and IPoIB/4X FDR Infiniband based). We also report the status of commissioning a large scale (1 PB of usable capacity, 4.0k HDDs behind the RAID arrays by design) Ceph based object storage system provided with AMZ/S3 complaint RadosGW interfaces which is currently being finalized within RACF, and the early performance results obtained with it.

Primary authors

Mr Alexandr Zaytsev (Brookhaven National Laboratory (US)) Dr Hironori Ito (Brookhaven National Laboratory (US))


Dr Antonio Wong (Brookhaven National Laboratory (US)) Mr Christopher Hollowell (Brookhaven National Laboratory (US)) Mr Tejas Rao (Brookhaven National Laboratory (US))

Presentation materials