Jul 9 – 13, 2018
Sofia, Bulgaria
Europe/Sofia timezone

Object store stress testing for ATLAS distributed computing

Jul 10, 2018, 4:00 PM
Sofia, Bulgaria

Sofia, Bulgaria

National Culture Palace, Boulevard "Bulgaria", 1463 NDK, Sofia, Bulgaria
Poster Track 7 – Clouds, virtualization and containers Posters


Peter Love (Lancaster University (GB))


Various workflows used by ATLAS Distributed Computing (ADC) are now using object stores as a convenient storage resource via boto S3 libraries. The load and performance requirement varies widely across the different workflows and for heavier cases it has been useful to understand the limits of the underlying object store implementation. This work describes the performance of various object stores used by ADC and describes a tool which run periodic functional tests and on-demand stress testing. Connection concurrency limits are measured and concurrency effects on error rate and object writing times are measured.

Primary authors

Peter Love (Lancaster University (GB)) Doug Benjamin (Duke University (US)) Alastair Dewhurst (STFC-Rutherford Appleton Laboratory (GB)) Jaroslava Schovancova (CERN)

Presentation materials