23–27 Sept 2024
Nikhef
Europe/Amsterdam timezone

Dynamic resource integration with COBalD/TARDIS

25 Sept 2024, 14:00
20m
Colloquium room (Nikhef)

Colloquium room

Nikhef

Nikhef Science Park 105 1098 XG Amsterdam
HTCondor user presentations Workshop Session

Speaker

Florian Von Cube (KIT - Karlsruhe Institute of Technology (DE))

Description

With the continuing growth of data volumes and computational demands, compute-intensive sciences rely on large-scale, diverse computing resources for running data processing, analysis tasks, and simulation workflows.
These computing resources are often made available to research groups by different resource providers resulting in a heterogeneous infrastructure.
To make efficient use of those resources, we are developing COBald/TARDIS, a resource management system for dynamic and transparent integration.

COBalD/TARDIS provides an abstraction layer of resource pools and sites and takes care of scheduling and requesting those resources, independent of their sites local resource management systems.
Through the use of adapters, COBalD/TARDIS is able to interface with a range of resource providers, including OpenStack, Kubernetes, and others, as well as support different overlay batch systems, with current implementations for HTCondor and SLURM.
In this contribution we present the general concepts of COBalD/TARDIS, several setups, with a focus on those using HTCondor, in different university groups, as well as WLCG sites.

Speaker release Yes

Authors

Eileen Kuhn (KIT - Karlsruhe Institute of Technology (DE)) Florian Von Cube (KIT - Karlsruhe Institute of Technology (DE)) Gunter Quast (KIT - Karlsruhe Institute of Technology (DE)) Manuel Giffels (KIT - Karlsruhe Institute of Technology (DE)) Matthias Jochen Schnepf Max Fischer (Karlsruhe Institute of Technology)

Presentation materials