19–25 Oct 2024
Europe/Zurich timezone

First Deployment of XCache for Workflow and Efficiency Optimizations on Opportunistic HPC Resources in Germany

22 Oct 2024, 17:27
18m
Large Hall B

Large Hall B

Talk Track 7 - Computing Infrastructure Parallel (Track 7)

Speaker

Robin Hofsaess (KIT - Karlsruhe Institute of Technology (DE))

Description

The efficient utilization of multi-purpose HPC resources for High Energy Physics applications is increasingly important, in particularly with regard to the upcoming changes in the German HEP computing infrastructure.
In preparation for the future, we are developing and testing an XRootD-based caching and buffering approach for workflow and efficiency optimizations to exploit the full potential of such resources despite the challenges and potential limitations associated with them.

With this contribution, we want to present a first prototype of our approach, deployed for optimizing the utilization of HoreKa, our local HPC cluster at KIT, that is opportunistically integrated into GridKa, the German Tier-1 center.
This includes first experiences and additional benefits for the operation of such sites that come with the additional monitoring capabilities of our setup.

Primary authors

Achim Streit (Karlsruhe Institute of Technology (KIT)) Andreas Petzold (KIT - Karlsruhe Institute of Technology (DE)) Artur Il Darovic Gottmann (KIT - Karlsruhe Institute of Technology (DE)) Gunter Quast (KIT - Karlsruhe Institute of Technology (DE)) Manuel Giffels (KIT - Karlsruhe Institute of Technology (DE)) Matthias Schnepf Robin Hofsaess (KIT - Karlsruhe Institute of Technology (DE))

Presentation materials