Description
Amazon S3 is a widely adopted web API for scalable cloud storage that could also fulll
storage requirements of the high-energy physics community. CERN has been evaluating this
option using some key HEP applications such as ROOT and the CernVM file system (CvmFS)
with S3 back-ends. In this contribution, we present an evaluation of two versions of the Huawei
UDS storage system stressed with a large number of clients executing HEP software applications.
The performance of concurrently storing individual objects is presented alongside with more
complex data access patterns as produced by the ROOT data analysis framework. Both Huawei
UDS generations show a successful scalability by supporting multiple-byte range requests in
contrast with Amazon S3 or Ceph which do not support these commonly used HEP operations.
We further report the S3 integration with recent CvmFS versions and summarize the experience
with CvmFS/S3 for publishing daily releases of the full LHCb experiment software stack.
Speakers
Maria Arsuaga Rios
(CERN)
Seppo Heikkila
(CERN)