25–28 Sept 2023
Imperial College London
Europe/London timezone

Graph Neural Networks on FPGAs with HLS4ML

25 Sept 2023, 18:10
5m
Blackett Laboratory, Lecture Theatre 1 (Imperial College London)

Blackett Laboratory, Lecture Theatre 1

Imperial College London

Blackett Laboratory
Lightning Talk Contributed Talks Contributed Talks

Speaker

Jan-Frederik Schulte (Purdue University (US))

Description

Graph structures are a natural representation of data in many fields of research, including particle and nuclear physics experiments, and graph neural networks (GNNs) are a popular approach to extract information from that. Simultaneously, there is often a need for very low-latency evaluation of GNNs on FPGAs. The HLS4ML framework for translating machine learning models from industry-standard Python implementations into optimized HLS code suitable for FPGA applications has been extended to support GNNs constructed using PyTorch Geometric (PyG). To that end, the parsing of general PyTorch models using symbolic tracing using the torch.FX package has been added to HLS4ML. This approach has been extended to enable parsing of PyG models and support for GNN-specific operations has been implemented. To demonstrate the performance of the GNN implementation in HLS4ML, a network for track reconstruction in the sPHENIX experiment is used. Future extensions, such as an interface to quantization-aware training with Brevitas, are discussed.

Primary authors

Jan-Frederik Schulte (Purdue University (US)) Miaoyuan Liu (Purdue University (US)) Philip Coleman Harris (Massachusetts Inst. of Technology (US)) Vladimir Loncar (Massachusetts Inst. of Technology (US))

Presentation materials