25–29 Apr 2022
Europe/Zurich timezone

XRootD object storage: native EC-based file store and S3 proxy

27 Apr 2022, 17:30
25m
Online workshop

Online workshop

Storage & Filesystems Storage & File Systems

Speaker

Michal Kamil Simon (CERN)

Description

Over the last years we have observed increasing importance of object storage in the WLCG community. In this contribution we report on our effort to accommodate object storage use cases within XRootD, a software framework that is a critical component for data access and management at WLCG sites. Firstly, we introduce a high performance erasure coding (EC) based file storage module motivated by the ALICE O2 use case and compatible with any type of XRootD backend storage. Furthermore, we discuss the XRootD proxy for S3 storage and native XRootD EC-based file store that provides the WLCG required data-transfer-node (DTN) facilities like third-party-copy, checksum query, VOMS authentication and access token support.

Desired slot length 20
Speaker release Yes

Authors

Andrew Hanushevsky (STANFORD LINEAR ACCELERATOR CENTER) Michal Kamil Simon (CERN) Wei Yang (SLAC National Accelerator Laboratory (US))

Presentation materials