25–29 May 2026
Chulalongkorn University
Asia/Bangkok timezone

Optimizing GNNs for the Wild: PyTorch-to-ONNX Acceleration of GarNet on CPUs and GPUs

26 May 2026, 14:21
18m
Chulalongkorn University

Chulalongkorn University

Oral Presentation Track 2 - Online and real-time computing Track 2 - Online and real-time computing

Speakers

Ronald Caravaca-Mora (Consejo Nacional de Rectores (CONARE) (CR)/Universidad de Costa Rica (UCR) (CR)) Cilicia Uzziel Perez (La Salle, Ramon Llull University (ES))

Description

Graph-based reconstruction methods are well-suited to the sparse and irregular geometry of modern calorimeters, but their deployment often depends on achieving low and predictable inference latency across heterogeneous computing environments. We evaluate GarNet, a lightweight Graph Neural Network (GNN) for calorimeter energy reconstruction, focusing on its cross-backend performance using PyTorch and ONNX Runtime on both multi-core CPUs and NVIDIA A100 GPUs. For small graph inputs representative of PicoCal deposits, ONNX Runtime delivers up to 5× faster CPU and nearly 2× faster GPU inference than Pytorch Runtime while maintaining FP32 numerical agreement at the 10⁻⁷ level.

This work is motivated by real-time deployment within the HLT1 reconstruction stage of the LHCb trigger, where the fully GPU-based Allen framework performs low-latency event processing to select interesting collisions at the LHC bunch-crossing rate. Integrating fast, portable ONNX-accelerated GarNet inference into this environment would enable graph-based calorimeter reconstruction to contribute directly to real-time decision-making in future high-rate running.

Author

Ronald Caravaca-Mora (Consejo Nacional de Rectores (CONARE) (CR)/Universidad de Costa Rica (UCR) (CR))

Co-authors

Cilicia Uzziel Perez (La Salle, Ramon Llull University (ES)) Irvin Jadurier Umana Chacon (Consejo Nacional de Rectores (CONARE) (CR)) Miriam Calvo Gomez (La Salle, Ramon Llull University (ES)) Sergio Arguedas Cuendis (Consejo Nacional de Rectores (CONARE) (CR)) Francisco Siles (Consejo Nacional de Rectores (CONARE) (CR)/Universidad de Costa Rica (UCR) (CR)) Xavier Vilasis Cardona (La Salle, Ramon Llull University (ES))

Presentation materials

There are no materials yet.