Mar 10 – 12, 2020
Fermilab
US/Central timezone

DUNE Data Management Experience with Rucio

Mar 10, 2020, 11:40 AM
20m
One West (WH1W) (Fermilab)

One West (WH1W)

Fermilab

Speaker

Steven Timm (Fermi National Accelerator Lab. (US))

Description

The DUNE collaboration has been using Rucio since 2018 to transport data to our many European remote storage elements. We currently have 13.8 PB of data under Rucio management at 13 remote storage elements. We present our experience thus far, as well as our future plans to make Rucio our sole file location catalog.
We will present our planned data discovery system, and the role of Rucio in the data ingest system and data delivery of files to jobs. We will describe the associated metadata service which is in development. Finally we will describe some of the unique challenges of configuring Rucio to the tape-backed dCache/Enstore disk store at Fermilab.

Presentation materials