Introduction to Parallel Programming with OpenMP
by
Abstract
In this course, we will cover the core concepts in parallel computing that anyone working in scientific computing should know. We will cover these concepts through ``hands-on'' learning.
To minimize time spent learning a new application programming interface (API), we will work with the simplest parallel programing API used in scientific computing: OpenMP. It's also the most commonly used API for parallel computing in the sciences.
OpenMP is mostly focussed on multithreaded programming for CPUs. It is important to appreciate, however, that the concepts we'll cover apply to the full range of parallel programming APIs and platforms used in scientific computing. After we finish discussing OpenMP for CPUs, we'll briefly discuss how OpenMP can be used for GPUs. Then we will complete our survey of parallelism in scientific computing by discussing MPI and its use for programming clusters.
We'll close the course with a short lecture on pseudo random numbers: what they are and how to safely use them in computational physics.
Lecturer Bio
Tim Mattson is a parallel programmer obsessed with every variety of science (Ph.D. Chemistry, UCSC, 1985). In 2023 he retired after a 45-year career in HPC (30 of which were with Intel).
During his long career he has had the privilege of working with smart people on great projects including: (1) the first TFLOP computer (ASCI Red), (2) Parallel programming languages … Linda, Strand, MPI, OpenMP, OpenCL, OCR and PyOMP (3) two different research processors (Intel’s TFLOP chip and the 48 core SCC), (4) Data management systems (Polystore systems and the TileDB Array-based storage engine), (5) the GraphBLAS API for expressing graph algorithms as sparse linear algebra.
Tim has over 150 publications including six books on different aspects of parallel computing.
He is also a recently retired kayak coach and instructor trainer (ACA certified). His obsession with sea kayaking, including “self-wetting” moments in the ocean, is pretty bad.
More information: https://timmattson.com/work/