9-13 July 2018
Sofia, Bulgaria
Europe/Sofia timezone

Optimising XRootD access to erasure coded object stores

10 Jul 2018, 16:00
Sofia, Bulgaria

Sofia, Bulgaria

National Culture Palace, Boulevard "Bulgaria", 1463 NDK, Sofia, Bulgaria
Poster Track 4 - Data Handling Posters


Alastair Dewhurst (STFC-Rutherford Appleton Laboratory (GB)) Rob Appleyard (STFC)


Since the start of 2017, the RAL Tier-1’s Echo object store has been providing disk storage to the LHC experiments. Echo provides access via both the GridFTP and XRootD protocols. GridFTP is primarily used for WAN transfers between sites while XRootD is used for data analysis.

Object stores and those using erasure coding in particular are designed to efficiently serve entire objects which are normally assumed to be small (few MBs). Some experiment workflows fit this use case extremely well, however certain work flows have been shown to be extremely inefficient when run directly against Echo. To solve this problem XRootD caches were deployed. This paper describes the performance testing of various configurations of both disk and memory caches.

Access to Echo happens via gateways. Echo has a small number of dedicated gateway machines that provide external connectivity. Jobs running on the RAL batch farm can access Echo through an XRootD gateway running inside a container on every worker node. This paper describes the setup of these worker node gateways which also provide a cache and the ability to redirect requests in the event a file is not found.

For CMS, a dedicated XCache service has been provided to allow remote jobs to access data directly from Echo. This paper describes the setup and testing of this service.

Primary authors

Andrew David Lahiff (STFC-Rutherford Appleton Laboratory (GB)) Alastair Dewhurst (STFC-Rutherford Appleton Laboratory (GB)) Rob Appleyard (STFC) Tom Byrne (STFC)

Presentation Materials