Conveners
Community talks
- Diego Davila Foyo (Univ. of California San Diego (US))
Community talks
- Cedric Serfon (Brookhaven National Laboratory (US))
Community talks
- Eric Vaandering (Fermi National Accelerator Lab. (US))
Community talks
- Diego Davila Foyo (Univ. of California San Diego (US))
Community talks
- Martin Barisits (CERN)
Community talks
- Martin Barisits (CERN)
In this talk, we will summarise the process by which the SKA formally selected Rucio as the Distributed Data Management solution for the first version (0.1) of the SKA Regional Centre network (SRCNet) stack. Presented with two possible solutions for managing the archive of SKA Observatory data products, we set out to objectively select the tool which best matched the SRCNet architecture,...
In this presentation, we will delve into the Rucio experience with the DUNE experiment, focusing on several key aspects. We will review the DUNE data module and share insights from our 2024 big data tests, including the WLCG Data Challenge, collaboration with LHC experiments, and our dress rehearsal. Additionally, we will discuss findings from the ongoing ProtoDUNE data taking with beam at...
The CERN IT department provides support for the needs of major LHC experiments and also small and medium experiments (SMEs).
In this talk we'll explain the deployments performed by the CERN IT community and the challenges and pitfalls we faced during the commissioning of Rucio prototype clusters for SMEs.
With the development of large scaled data experiments located in China, the Computing Center of Institute of High Energy Physics (IHEP) started to use Rucio system to manage Grid data distribution among multiple storage sites. At present, HERD, JUNO, CEPC experiment at IHEP are using or have determined to use Rucio as distributed data management system. This report will share our uses cases on...
In this talk I will give an overview of the current state of Rucio at Port d'Informació Científica (PIC). I will review the projects that are currently using it and those for which we are considering its use. I will also provide an explanation of the developments we have made for its deployment and integration.
In this presentation, we will explore the Rucio experience with the Rubin Observatory experiment. Our discussion will cover several key areas:
Scalability Tests: Insights into the performance and scalability evaluations of Rucio in the context of Rubin’s data needs.
Integration with Rubin’s Data Butler: An overview of integrating Rucio with Rubin’s Data Butler using Hermes-K, which involves...
For the Cherenkov Telescope Array Observatory (CTAO), Rucio has been selected as the core technology for managing and archiving raw data collected from the La Palma and Chile telescope sites. It is a key component of the Bulk Data Management System (BDMS) within the Data Processing and Preservation System (DPPS), providing efficient storage, transfer, and replication. In addition to raw data...
Instrumental observations from the International Gravitational Wave Network (IGWN) are aggregated into bulk data files for access in distributed computing environments via the OSDF and for long-term archival storage. I will discuss how Rucio is used to manage these data products in LIGO and Virgo, focusing particularly on the LIGO deployment architecture and client tooling used to exploit the...
The Belle II experiment is a B-factory experiment located on the SuperKEKB accelerator complex at KEK in Japan. Since January 2021, Rucio is responsible for managing all the data produced across the data centers used by Belle II over their full lifecycle. In particular it ensures the proper replication of all the data according to the replication policies of Belle II. In this talk we will show...
Modern physics experiments are often led by large collaborations including scientists and institutions from different parts of the world. To cope with the ever increasing computing and storage demands, computing resources are nowadays offered as part of a distributed infrastructure. Einstein Telescope (ET) is a future third-generation interferometer for gravitational wave (GW) detection, and...
In this talk we are going to describe the operational and conceptual design of the bulk archive management system involved in prototyping activities of the Cherenkov Telescope Array Observatory (CTAO) Bulk Archive. This particular archive in the CTA Observatory takes care of storage and management of the lower data level products coming from the Cherenkov telescopes, incuding their cameras,...