LPHE seminars

How much do HEP foundation models share? Measuring representational alignment on LHC data.

by Kinga Anna Wozniak (Universite de Geneve (CH))

→ Europe/Zurich
BSP 626 (EPFL)

BSP 626

EPFL

https://plan.epfl.ch/?room=BSP%20626
Description

A growing body of evidence suggests that independently trained neural networks converge towards related internal representations, even when their latent spaces come from different architectures, training data and objectives. Recent work traces this convergence to local neighbourhood similarities that persist across models. We test whether the same holds for foundation models in high-energy physics, using two models trained on the JetClass dataset and applied to real CMS collision data. If this hypothesis holds, the learned representations carry semantic value and offer a new basis for physics analysis. Latent-space methods have already been used in model-independent searches, but because the latent space was uncharacterised, these analyses were limited to distance- or density-based anomaly scores. Evidence that a shared latent space is semantically structured would make it possible to navigate that space directly in the search for new physics, potentially guided by its geometry.

Organised by

Irene Bachiller Perea, Ismet Siral

Zoom Meeting ID
63456304525
Host
Lesya Shchutska
Alternative hosts
Olivier Schneider, Ismet Siral, Chiara Perrina, Alexandre Brea Rodriguez, Fred Blanc, Radoslav Marchevski, Laurent Dufour
Passcode
4203041890
Useful links
Join via phone
Zoom URL