30 November 2020 to 3 December 2020
Southern Methodist University
America/Chicago timezone

Building the tools to run large scale machine learning with FPGAs with two new approaches: AIGEAN and FAAST

1 Dec 2020, 15:28
8m
Southern Methodist University

Southern Methodist University

Talk

Speaker

Naif Tarafdar (University of Toronto)

Description

FPGA programming is becoming easier as the vendors begin to provide environments, such as for machine learning (ML), that enable programming at higher levels of abstraction.The vendor platforms target FPGAs in a single host server.To scale to larger systems of FPGAs requires communication through the hosts, which has a significant impact on performance. We demonstrate the deployment of ML algorithms on single FPGAs through FAAST a newly developed FPGA based infrastructure framework. We also present a new Framework, AIGEAN, to run multiple FPGA and CPU heterogeneous system that can leverage direct FPGA-to-FPGA communication links. AIgean and FAAST, take as input an ML algorithm created with a standard ML framework and a specification of the available FPGA and CPU resources. The outputs are software and hardware cores that can compute one or more ML layers. These layers can be distributed across a heterogeneous cluster of CPUs and FPGAs for execution. As part of this work we present an optimized FPGA implementation of a CNNs. We show that in some cases FPGAs can exceed the performance of other accelerators, including GPUs.

Primary authors

Dylan Sheldon Rankin (Massachusetts Inst. of Technology (US)) Philip Coleman Harris (Massachusetts Inst. of Technology (US))

Presentation materials