9–13 Jul 2018
Sofia, Bulgaria
Europe/Sofia timezone

XRootD Erasure Coding Plugin

10 Jul 2018, 16:00
1h
Sofia, Bulgaria

Sofia, Bulgaria

National Culture Palace, Boulevard "Bulgaria", 1463 NDK, Sofia, Bulgaria
Poster Track 4 - Data Handling Posters

Speakers

Michal Kamil Simon (CERN) Andreas Joachim Peters (CERN)

Description

XRootD is distributed low-latency file access system with its own communication protocol and scalable, plugin based architecture. It is the primary data access framework for the high-energy physics community, and the backbone of the EOS service at CERN.

In order to bring the potential of Erasure Coding (EC) to the XrootD / EOS ecosystem an effort has been undertaken to implement a native EC XrootD plugin based on the Intel Storage Acceleration Library (ISAL). In this contribution we discuss the architecture of the plugin, carefully engineered in order to enable low latency data streaming and 2D erasure coding. Moreover, we give an overview of the data repair and placement strategies. Finally, we report on the observed performance of the EC plugin and the project outcomes.

Primary authors

Presentation materials