30 September 2024 to 4 October 2024
San Diego Supercomputer Center, US
US/Pacific timezone

Rucio at LSST/Rubin

1 Oct 2024, 09:20
20m
San Diego Supercomputer Center, US

San Diego Supercomputer Center, US

Speaker

Yuyi Guo (Fermi National Accelerator Lab. (US))

Description

In this presentation, we will explore the Rucio experience with the Rubin Observatory experiment. Our discussion will cover several key areas:
Scalability Tests: Insights into the performance and scalability evaluations of Rucio in the context of Rubin’s data needs.
Integration with Rubin’s Data Butler: An overview of integrating Rucio with Rubin’s Data Butler using Hermes-K, which involves message passing through Kafka.
Monitoring and Support: Current status of Rucio and PostgreSQL monitoring and Rucio deployment and support within the Rubin environment.
Tape RSE Implementation: Deal with the order of magnitude more files going to tape than HEP.
Future Needs: An examination of Rubin’s evolving requirements for Rucio services and how we plan to address them.

Author

Yuyi Guo (Fermi National Accelerator Lab. (US))

Presentation materials