21-25 August 2017
University of Washington, Seattle
US/Pacific timezone

The ATLAS Data Management System Rucio: Supporting LHC Run-2 and beyond

Aug 24, 2017, 4:00 PM
45m
The Commons (Alder Hall)

The Commons

Alder Hall

Poster Track 1: Computing Technology for Physics Research Poster Session

Speaker

Simone Campana (CERN)

Description

With this contribution we present the recent developments made to Rucio, the data management system of the High-Energy Physics Experiment ATLAS. Already managing 260 Petabytes of both official and user data, Rucio has seen incremental improvements throughout LHC Run-2, and is currently laying the groundwork for HEP computing in the HL-LHC era. The focus of this contribution are (a) the automations that have been put in place such as data rebalancing or dynamic replication of user data, as well as their supporting infrastructures such as real-time networking metrics or transfer time predictions; (b) the flexible approach towards inclusion of heterogeneous storage systems, including object stores, while unifying the potential access paths using generally available tools and protocols; (c) the improvements made to the real time monitoring of the system to alleviate the work of our human shifters; and (d) the adoption of Rucio for two other experiments, AMS and Xenon1t. We conclude by presenting operational numbers and figures to quantify these improvements, and extrapolate the necessary changes and developments for future LHC runs.

Primary authors

Martin Barisits (CERN) Thomas Beermann (CERN) Vincent Garonne (University of Oslo (NO)) Tomas Javurek (Albert-Ludwigs-Universitaet Freiburg (DE)) Mario Lassnig (CERN) Cedric Serfon (University of Oslo (NO)) Simone Campana (CERN)

Presentation materials

Peer reviewing

Paper