29 January 2024 to 2 February 2024
CERN
Europe/Zurich timezone

Finetuning Foundation Models for Joint Analysis Optimization - Poster

1 Feb 2024, 17:05
5m
61/1-201 - Pas perdus - Not a meeting room - (CERN)

61/1-201 - Pas perdus - Not a meeting room -

CERN

10
Show room on map
Poster (from contributed talk) 2 ML for analysis : event classification, statistical analysis and inference, including anomaly detection Poster Session

Speaker

Matthias Vigl (Technische Universitat Munchen (DE))

Description

Most searches at the LHC employ an analysis pipeline consisting of various discrete components, each individually optimized and later combined to provide relevant features used to discriminate SM background from potential signal. These are typically high-level features constructed from particle four-momenta. However, the combination of individually optimized tasks doesn't guarantee an optimal performance on the final analysis objective. In this study, we show how an analysis would benefit from adopting an end-to-end ML optimization approach. Specifically, we investigate the impact of jointly optimizing particle identification and signal vs background discrimination exploiting the transformer-based ParT architecture [arXiv:2202.03772] as foundation model, showing the effectiveness of finetuning in the case of multi jets final states with CMS open data [DOI:10.7483/OPENDATA.CMS.JGJX.MS7Q].

Primary authors

Lukas Alexander Heinrich (Technische Universitat Munchen (DE)) Matthias Vigl (Technische Universitat Munchen (DE)) Nicole Michelle Hartman (TUM (DE))

Presentation materials