30 September 2024 to 4 October 2024
San Diego Supercomputer Center, US
US/Pacific timezone

DaFab: Extending Rucio for Enhanced Earth Observation Data Management

30 Sept 2024, 14:00
20m
San Diego Supercomputer Center, US

San Diego Supercomputer Center, US

Speaker

Dimitrios Xenakis (CERN)

Description

The DaFab project introduces a significant application and extension of Rucio in the domain of Earth Observation (EO) data management. This initiative aims to enhance Copernicus data exploitation by leveraging and expanding Rucio's catalog capabilities, alongside advanced AI and High-Performance Computing technologies. We outline how DaFab plans to utilize Rucio's existing metadata management features as a foundation for addressing unique challenges of EO data. Central to the project's vision is the expansion of Rucio's metadata capabilities, including the development of a unified, searchable catalogue of interlinked EO metadata. These enhancements are designed to facilitate improved discovery, access, and utilization of EO data. By exploring these proposed developments, we illustrate how the DaFab project not only aims to benefit from Rucio's existing strengths in cataloging but also intends to contribute back to the Rucio community, expanding its applicability in other data-intensive scientific domains.

Author

Dimitrios Xenakis (CERN)

Presentation materials