EOS Workshop

Session

Developing EOS & CO

5 Feb 2018, 09:45

31/3-004 - IT Amphitheatre (CERN)

33. Introdution: from workshop to workshop

Andreas Joachim Peters (CERN)

05/02/2018, 09:45

This presentation will be a short introduction to the workshop agenda and provide some basic context to understand the current status and the future roadmap.

20. The new EOS website

Dr Maria Arsuaga Rios (CERN)

05/02/2018, 09:55

The aim of this presentation is the introduction of the new EOS website, where users and developers can find all the information that they need in one place with an easy interaction and accessibility from all type of devices.

31. The EOS Citrine Version

Elvin Alin Sindrilaru (CERN)

05/02/2018, 10:10

This presentation will cover the development and current status of the EOS Citrine release.

14. The new namespace and QuarkDB

Georgios Bitzes (CERN)

05/02/2018, 10:30

EOS has outgrown the limits of its legacy in-memory namespace implementation, presenting the need for a more scalable solution. In response to this need we developed QuarkDB, a highly-available datastore capable of serving as the metadata backend for EOS.

We will present the overall system design, and several important aspects associated with it, such as our efforts in providing comparable...

12. A new FUSE based file system client for EOS

Andreas Joachim Peters (CERN)

05/02/2018, 10:50

Since the last workshop, the FUSE client has been rewritten. In this presentation we will discuss in detail the new implementation, its configuration and the new performance metrics.

5. The EOS Citrine Scheduler and new Centralized Drain

Andrea Manzi (CERN)

05/02/2018, 11:20

This presentation will show the status and plans for the EOS Citrine Scheduler component focusing in particular on the configuration aspects. The talk will also introduce the new implementation of the Drain subsystem which now uses the GeoTreeEngine component for the drain placement selection.

21. New approach of FST metadata storage

Jozsef Makai (CERN)

05/02/2018, 11:35

EOS FST has been storing file metadata in different relational databases, so far. In order to simplify handling them, the way of storing file metadata is going to be changed to store Base64 encoded, serialized Protobuf metadata objects as extended attributes.

This approach also gave us the advantage to easily compress the metadata, allowing an average compression ratio of 0.5 and saving 50%...

22. WLCG Accounting of EOS and smart files

Jozsef Makai (CERN)

05/02/2018, 11:50

WLCG Accounting is an important task to monitor the available and used resources of the LHC computation grid. Accountable resources involve EOS storage space for the experiments.

In order to support this task force from the EOS side, EOS has introduced a new accounting interface (see accounting CLI command) to make the necessary information easily available. The accounting information consist...

23. XROOT development update - year 2017

Michal Kamil Simon (CERN)

06/02/2018, 09:00

XRootD is a distributed, scalable system for low-latency file access. It is the primary data access framework for the high-energy physics community, and the backbone of EOS project.
In this contribution we (briefly) discuss the most important new features introduced in year 2017 including: support for systemd socket inheritance, XrdSsi, Caching Proxy v2, support for local files and...

24. XrootD Erasure Coding Plugin

Michal Kamil Simon (CERN)

06/02/2018, 09:20

In order to bring the potential of Erasure Coding (EC) to the XrootD / EOS ecosystem an effort has been undertaken to implement a native EC XrootD plugin based on the Intel Storage Acceleration Library (ISAL). In this contribution we discuss the architecture of the plugin, carefully engineered in order to enable low latency data streaming and 2D erasure coding. Also, we report on the status,...

17. User authentication in eosxd: A tale of /proc/pid/environ and kernel deadlocks

Georgios Bitzes (CERN)

06/02/2018, 09:30

Supporting multiple parallel users in eosxd requires some mechanism of distinguishing their identities, and assigning a different set of credentials to each.

In this presentation, we detail our efforts in implementing the eosxd authentication subsystem based on process environment variables.

However, reading the environment variables of a process (/proc/pid/environ) from within a FUSE daemon...

32. EOS Code Structure & Testing

Elvin Alin Sindrilaru (CERN)

06/02/2018, 09:45

This presentation will give an overview of the code structure, resources, simple docker-based testing and more.