Sep 1 – 5, 2025
ETH Zurich
Europe/Zurich timezone

When Less is More: Optimizing Graph Neural Networks and Knowledge Distillation for Efficient Particle Reconstruction and Identification in LHCb's Next-Generation Calorimeter

Not scheduled
20m
HIT G floor (gallery)

HIT G floor (gallery)

Speaker

Cilicia Uzziel Perez (La Salle, Ramon Llull University (ES))

Description

Graph Neural Networks (GNNs) have become promising candidates for particle reconstruction and identification in high-energy physics, but their computational complexity makes them challenging to deploy in real-time data processing pipelines. In the next-generation LHCb calorimeter, detector hits—characterized by energy, position, and timing—can be naturally encoded as node features, with spatial and energy-based relationships captured through edge features. This study investigates strategies to reduce both the structural complexity and numerical precision of GNNs to meet stringent real-time processing and resource constraints. We demonstrate that omitting explicit edge features and replacing conventional full message passing with learnable, permutation-invariant aggregation functions results in up to an 8× reduction in CPU inference time, while maintaining or even surpassing the energy resolution and classification performance of baseline methods. Furthermore, we explore post-training quantization, reducing model weights from 32-bit floating point (FP32) to 16-bit or 8-bit integers. While quantization could potentially offer additional efficiency gains, lightweight GNNs with approximately ~100k parameters exhibit minor inference time performance degradation under aggressive precision reduction. We also present our knowledge distillation experiment, where we train a compact student model to mimic the performance of a larger, more complex teacher network. Our findings provide practical design guidelines for developing fast, efficient, and high-performing GNNs for real-time particle reconstruction in LHCb's upgraded calorimeter, while also highlighting the limitations of quantization in small neural network architectures.

Authors

Andrey Ustyuzhanin (Constructor University (DE)) Cilicia Uzziel Perez (La Salle, Ramon Llull University (ES)) Elisabet Golobardes Ribe (La Salle, Ramon Llull University (ES)) Felipe Luan Souza De Almeida (Syracuse University (US)) Jonas Eschle Julian Garcia Pardinas (Massachusetts Inst. of Technology (US)) Justin Bartz (Syracuse University (US)) Katya Govorkova (Massachusetts Inst. of Technology (US)) Ke Wei (Wuhan University (CN)) Matthew Scott Rudolph (Syracuse University (US)) Miriam Calvo Gomez (La Salle, Ramon Llull University (ES)) Rafael Silva Coutinho (CBPF - Brazilian Center for Physics Research (BR)) Xavier Vilasis Cardona (La Salle, Ramon Llull University (ES))

Presentation materials