29 January 2024 to 2 February 2024
CERN
Europe/Zurich timezone

Finetuning Foundation Models for Joint Analysis Optimization

30 Jan 2024, 16:30
20m
40/S2-D01 - Salle Dirac (CERN)

40/S2-D01 - Salle Dirac

CERN

115
Show room on map
Contributed talk 2 ML for analysis : event classification, statistical analysis and inference, including anomaly detection Contributed Talks

Speaker

Matthias Vigl (Technische Universitat Munchen (DE))

Description

Most searches at the LHC employ an analysis pipeline consisting of various discrete components, each individually optimized and later combined to provide relevant features used to discriminate SM background from potential signal. These are typically high-level features constructed from particle four-momenta. However, the combination of individually optimized tasks doesn't guarantee an optimal performance on the final analysis objective. In this study, we show how an analysis would benefit from adopting an end-to-end ML optimization approach. Specifically, we investigate the impact of jointly optimizing particle identification and signal vs background discrimination exploiting the transformer-based ParT architecture [arXiv:2202.03772] as foundation model, showing the effectiveness of finetuning in the case of multi jets final states with CMS open data [DOI:10.7483/OPENDATA.CMS.JGJX.MS7Q].

Authors

Lukas Alexander Heinrich (Technische Universitat Munchen (DE)) Matthias Vigl (Technische Universitat Munchen (DE)) Nicole Michelle Hartman (TUM (DE))

Presentation materials