26–30 Aug 2024
Aachen, Germany
Europe/Brussels timezone

b2luigi — bringing batch 2 luigi!

28 Aug 2024, 09:40
20m
Aachen, Germany

Aachen, Germany

Erholungs-Gesellschaft Reihstraße 13, 52062 Aachen

Speakers

Alexander Heidelbach Jonas Eppelt (Karlsruher Insititute of Technology (KIT))

Description

Workflow managers help structure the code of pipelined jobs by defining and managing dependencies between tasks in a clear and easy-to-understand fashion. This abstraction allows independent tasks to be automatically parallelised more independently of computing systems. Additionally, workflow managers help keep track of different tasks’ outputs and inputs.

b2luigi is an extension of the workflow manager luigi and offers easy integration with batch systems such as HTCondor and LSF, allowing the combination of different systems within one workflow.

b2luigi also provides additional interfaces tailored for Belle II workflows, allowing smooth interaction with the Belle II analysis software framework and distributed computing. Workflows such as VIBE, an automated Monte Carlo validation framework, the Systematics Framework, and many Belle II physics analyses have been automated using b2luigi.

As the current maintainers of b2luigi and Belle II users, we look forward to discussing our experiences and plans for this tool at the PyHep 2024 conference.

Authors

Alexander Heidelbach Jonas Eppelt (Karlsruher Insititute of Technology (KIT))

Presentation materials