3–6 Oct 2022
Southern Methodist University
America/Chicago timezone

CryoAI – Prototyping cryogenic chips for machine learning at 22nm

4 Oct 2022, 16:45
15m
Southern Methodist University

Southern Methodist University

Speaker

Mr Manuel Valentin (Northwestern University)

Description

We present our design experience of a prototype System-on-Chip (SoC) for machine learning applications that run in a cryogenic environment to evaluate the performance of the digital backend flow. We combined two established open-source projects (ESP and HLS4ML) into a new system-level design flow to build and program the SoC. In the modular tile-based architecture, we integrated a low-power 32-bit RISC-V microcontroller (Ibex), 200KB SRAM-based scratchpad, and an 18K-parameter neural-network accelerator. The network is an autoencoder working on audio recordings and trained on industrial use cases for the early detection of failures in machines like slide rails, fans, or pumps. For the hls4ml translation, we optimized the reference architecture using quantization and model compression techniques with minimal AUC performance reduction. This project is also an early evaluation of Siemens Catapult as an HLS backend for hls4ml. Finally, we fabricated the SoC in a 22nm technology and are currently testing it.

Primary authors

Chinar Syal (Fermi National Accelerator Lab. (US)) Davide Giri (Columbia University) Farah Fahim (Fermilab) Giuseppe Di Guglielmo (Fermilab) Joseph Zuckerman (Columbia University) Luca Carloni (Columbia University) Maico Cassel Dos Santos (Columbia University) Mr Manuel Valentin (Northwestern University) Nhan Tran (Fermi National Accelerator Lab. (US)) Seda Memik (Northwestern University)

Presentation materials