15–19 Sept 2025
FZU - Institute of Physics of the Czech Academy of Sciences
Europe/Prague timezone

HTC Accounting with AUDITOR

17 Sept 2025, 11:00
20m
FZU - Institute of Physics of the Czech Academy of Sciences

FZU - Institute of Physics of the Czech Academy of Sciences

Pod Vodárenskou věží 2531/3 Praha 8 Czechia
HTCondor user presentations Workshop Session

Speaker

Dirk Sammel (University of Freiburg (DE))

Description

In the realm of High Throughput Computing (HTC), managing and processing large volumes of accounting data across diverse environments and use cases presents significant challenges. AUDITOR addresses this issue by providing a flexible framework for building accounting pipelines that can adapt to a wide range of needs.
At its core, AUDITOR serves as a centralized storage solution for accounting records, facilitating data exchange through a REST interface. This enables seamless interaction with the other parts of the AUDITOR ecosystem: the collectors, which gather accounting data from various sources and push it to AUDITOR, and the plugins, which pull data from AUDITOR for subsequent processing. The modular nature of AUDITOR allows for the customization of collectors and plugins to match specific use cases and environments, ensuring a tailored approach to the management of accounting data. The most important collector for HTC is the HTCondor collector, which retrieves the required job ClassAds from HTCondor and converts them into the AUDITOR record structure.
This presentation will outline the structure of the AUDITOR accounting ecosystem with a special focus on the HTCondor collector, demonstrate existing accounting pipelines and show how AUDITOR could be extended to account environmentally sustainable computing resources.

Desired slot length 15
Speaker release Yes

Author

Dirk Sammel (University of Freiburg (DE))

Co-authors

Florian Von Cube (KIT - Karlsruhe Institute of Technology (DE)) Manuel Giffels (KIT - Karlsruhe Institute of Technology (DE)) Matthias Schnepf Max Fischer Michael Boehler (University of Freiburg (DE)) Raghuvar Vijayakumar (University of Freiburg (DE)) Raphael Kleinemuehl

Presentation materials