Speaker
Peter Love
(Lancaster University (GB))
Description
Various workflows used by ATLAS Distributed Computing (ADC) are now using object stores as a convenient storage resource via boto S3 libraries. The load and performance requirement varies widely across the different workflows and for heavier cases it has been useful to understand the limits of the underlying object store implementation. This work describes the performance of various object stores used by ADC and describes a tool which run periodic functional tests and on-demand stress testing. Connection concurrency limits are measured and concurrency effects on error rate and object writing times are measured.
Authors
Peter Love
(Lancaster University (GB))
Doug Benjamin
(Duke University (US))
Alastair Dewhurst
(STFC-Rutherford Appleton Laboratory (GB))
Jaroslava Schovancova
(CERN)