25–29 Apr 2022
Europe/Zurich timezone

Getting FTS at CERN ready for LHC Run3

28 Apr 2022, 16:00
25m
Online workshop

Online workshop

Grid, Cloud & Virtualisation Grid, Cloud & Virtualisation

Speaker

Joao Pedro Lopes

Description

The File Transfer Service (FTS) is responsible for distributing the majority of the LHC data across the WLCG infrastructure. FTS schedules and executes data transfers, maximizing the use of available network and storage resources whilst easing the complexity of the grid environment by masking the details of the different underlying transfer protocols and storage endpoints.

The FTS service is used by more than 30 experiments within the WLCG. In 2021 FTS transferred more than one billion files across various WLCG sites, adding up to more than one exabyte of data. With Run3 rapidly approaching, the CERN service has shifted focus on service consolidation, aiming for increased reliability, ease of operation and built-in service-health monitoring. The software stack has been modernized to facilitate this consolidation, most notably this has included the replacement of all Python2 components by their new Python3 counterparts.

This presentation will share the lessons learnt and the improvements accomplished whilst preparing the FTS service for LHC Run 3. In particular the presentation will cover the new log-based monitoring service and the new database deployment strategy. An overview of the software improvements will also be given.

Desired slot length 15
Speaker release Yes

Authors

Joao Pedro Lopes Luca Mascetti (CERN) Mihai Patrascoiu (CERN) Steven Murray (CERN)

Presentation materials