Experience with Rucio in the wider HEP community

20 May 2021, 15:26
13m
Short Talk Distributed Computing, Data Management and Facilities Distributed Computing

Speaker

Martin Barisits (CERN)

Description

Managing the data of scientific projects is an increasingly complicated challenge, which was usually met by developing experiment-specific solutions. However, the ever-growing data rates and requirements of even small experiments make this approach very difficult, if not prohibitive. In recent years the scientific data management system Rucio has evolved into a successful open-source project, now being used by many scientific communities and organisations. Rucio is incorporating the contributions and expertise of many scientific projects, offering common features useful to a diverse research community. This article describes the recent experiences in operating Rucio as well as contributions to the project by ATLAS, Belle II, CMS, ESCAPE, IGWN, LDMX, Folding@Home, and the UK's Science and Technology Facilities Council (STFC).

Primary authors

Martin Barisits (CERN) Thomas Beermann (Bergische Universitaet Wuppertal (DE)) David Cameron (University of Oslo (NO)) James Alexander Clark (California Institute of Technology) Dr Riccardo Di Maria (CERN) Mr Gabriele Gaetano Fronze' (INFN Torino (IT) and LIGO-Virgo-Kagra Collaboration (US/IT/JP)) Ian Johnson (STFC Rutherford Appleton Laboratory) Mario Lassnig (CERN) Cedric Serfon (Brookhaven National Laboratory (US)) Eric Vaandering (Fermi National Accelerator Lab. (US))

Presentation materials

Proceedings

Paper