Indico celebrates its 20th anniversary! Check our blog post for more information!

19–20 Jun 2024
Uni Mail - University of Geneva
Europe/Zurich timezone

Human-in-the-loop Reinforcement Learning for Data Quality Monitoring in Particle Physics Experiments

Not scheduled
20m
Uni Mail - University of Geneva

Uni Mail - University of Geneva

Bd du Pont-d'Arve 40 1205 Genève

Speaker

Olivia Jullian Parra (CERN)

Description

Data Quality Monitoring (DQM) is a crucial task in large particle physics experiments, since detector malfunctioning can compromise the data. DQM is currently performed by human shifters, which is costly and results in limited accuracy. In this work, we provide a proof-of-concept for applying human-in-the-loop Reinforcement Learning (RL) to automate the DQM process while adapting to operating conditions that change over time. We implement a prototype based on the Proximal Policy Optimization (PPO) algorithm and validate it on a simplified synthetic dataset. We demonstrate how a multi-agent system can be trained for continuous automated monitoring during data collection, with human intervention actively requested only when relevant. We show that random, unbiased noise in human classification can be reduced, leading to an improved accuracy over the baseline. Additionally, we propose data augmentation techniques to deal with scarce data and to accelerate the learning process. Finally, our studies can be found in arXiv by the following link: https://arxiv.org/abs/2405.15508.

Primary authors

Olivia Jullian Parra (CERN) Julian Garcia Pardinas (CERN) Lorenzo Del Pianta (CERN) Maximilian Janisch Suzanne Klaver (Nikhef National institute for subatomic physics (NL)) Thomas Lehéricy Nicola Serra (University of Zurich (CH))

Presentation materials

There are no materials yet.