19–25 Oct 2024
Europe/Zurich timezone

Accounting of (HPC) computing resources with AUDITOR

MON 04
21 Oct 2024, 15:18
57m
Exhibition Hall

Exhibition Hall

Poster Track 4 - Distributed Computing Poster session

Speaker

Michael Boehler (Albert Ludwigs Universitaet Freiburg (DE))

Description

New strategies for the provisioning of compute resources, e.g. in the form of dynamically integrated resources enabled by the COBalD/TARDIS software toolkit, require a new approach of collecting accounting data. AUDITOR (AccoUnting DatahandlIng Toolbox for Opportunistic Resources), a flexible and expandable accounting ecosystem that can cover a wide range of use cases and infrastructures, was developed specifically for this purpose. Accounting data is collected via so-called collectors and stored in a database. So-called plugins can access the data and act based on the accounting information. Access to the data is handled by the core component of AUDITOR, which provides a REST API together with a Rust and a Python client library.
An HTCondor collector, a Slurm collector and a TARDIS collector are currently available, and a Kubernetes collector is already in the works.
The APEL plugin enables, for example, the creation of APEL accounting summaries and their transmission to the APEL accounting server. Although the original aim of the development of AUDITOR was to enable the accounting of opportunistic resources managed by COBalD/TARDIS, it can also be used for standard accounting of a WLCG computing resource. As AUDITOR uses a highly flexible data structure to store accounting data, extensions such as GPU resource accounting can be added with minimal effort.
This contribution provides insights into the design of AUDITOR and shows how it can be used to enable a number of different use cases.

Author

Michael Boehler (Albert Ludwigs Universitaet Freiburg (DE))

Co-authors

Benjamin Rottler (Albert Ludwigs Universitaet Freiburg (DE)) Dirk Sammel (Albert Ludwigs Universitaet Freiburg (DE)) Florian Von Cube (KIT - Karlsruhe Institute of Technology (DE)) Manuel Giffels (KIT - Karlsruhe Institute of Technology (DE)) Matthias Schnepf Max Fischer (Karlsruhe Institute of Technology) Michael Huebner (University of Bonn (DE)) Oliver Freyermuth (University of Bonn (DE)) Raghuvar Vijayakumar (Albert Ludwigs Universitaet Freiburg (DE)) Raphael Kleinemuehle (Uni Wuppertal)

Presentation materials