Thematic CERN School of Computing 2022

1 May 2022, 16:00 → 7 May 2022, 09:00 Europe/Paris

Cargèse, Corsica, France

Sebastian Lopienski (CERN), Joelma Tolomeo (CERN), Jarek Polok (CERN)

The 10th Thematic CERN School of Computing (tCSC 2022) will take place on May 1-7, 2022. The theme of the school is "Scientific Software for Heterogeneous Architectures" - see the academic programme for more details.

This School is organized by CERN. Assuming a positive evolution of the pandemic, the school will take place in Cargèse, France, and be hosted at the Institut d’Études Scientifiques de Cargèse (IESC). The Institute is located on the west coast of the French island of Corsica, 50 km north of Ajaccio city and its international airport. (However, if the pandemic situation doesn't allow traveling or physical presence, the school will be moved to online format.)

The School is aimed at postgraduate (i.e. minimum of Bachelor degree or equivalent) students, engineers and scientists with a few years' experience in particle physics, in computing, or in related fields. We welcome applications from all countries and nationalities.

Applications are now closed

Important Dates

• Thursday December 9, 2021 - applications open
• Sunday January 23  - application deadline
• Thursday February 10 - invitations sent to the selected participants
• Sunday March 20 - registration fee payment deadline
• Sunday May 1 to Saturday May 7 - the school

         

IESC Participant Guide 2022.pdf

tCSC 2022 Booklet.pdf

Sunday 1 May

16:00 Registration

19:30 Dinner (self-organized)

Monday 2 May

08:00 Breakfast

1 Opening Session

Speakers: Enrica Maria Porcari (CERN), Sebastian Lopienski (CERN)

2022.05 Welcome to the CSC.pdf

2022.05 Welcome to the CSC.pptx

2 Self-presentation: 1 minute per person

CSC core team - one slide per person.pdf

tCSC 2022 self-presentations.pdf

10:00 Coffee break

3 Preparing for the HL-LHC computational challenge

In this talk we will introduce some basic concepts related to HEP data processing and analysis workflows, seeing them in action in the context of LHC experiments. We’ll also talk about the evolution of the LHC accelerator and experiments. We’ll characterise at a high level what are the consequences of those upgrades for the HEP data processing software, in particular in the context of an evolving hardware and computing infrastructure.

Speaker: Danilo Piparo (CERN)

tCSC2022_Intro.pdf

4 Introduction to efficient computing

Technologies and Platforms - lecture 1

• The evolution of computing hardware and what it means in practice
• The seven dimensions of performance
• Controlling and benchmarking your computer and software
• Software that scales with the hardware
• Advanced performance tuning in hardware

Speaker: Andrzej Nowak

A.Nowak-01 Introduction to Efficient Computing-tCSC2022.pdf

12:20 Lunch

13:00 Study time and/or daily sports

5 Self-presentation: 1 minute per person

6 Hardware evolution and heterogeneity

Technologies and Platforms - lecture 2

• Accelerators, co-processors, heterogeneity
• Memory architectures, hardware caching and NUMA
• Compute devices: CPU, GPU, FPGA, ASIC etc.
• The role of compilers

Speaker: Andrzej Nowak

A.Nowak-02 Hardware Evolution and Heterogeneity-tCSC2022.pdf

15:20 Coffee break

7 Technologies and Platforms - exercise

Speaker: Andrzej Nowak

8 Data-oriented design

Technologies and Platforms - lecture 3

• Hardware vectorization in detail – theory vs. practice
• Software design for vectorization and smooth data flow
• How can compilers and other tools help?

Speaker: Andrzej Nowak

A.Nowak-03 Data Oriented Design-tCSC2022.pdf

19:30 Opening dinner

Tuesday 3 May

08:00 Breakfast

9 Writing parallel software

Parallel and Optimised Scientific Software - lecture 1

• Amdahl's and Gustafson's laws
• Asynchronous execution
• Finding concurrency, task vs. data parallelism
• Using threading in C++ and Python, comparison with multi-process
• Resource protection and thread safety
• Locks, thread local storage, atomic operations

Speaker: Sebastien Ponce (CERN)

Course and exercise sources

WritingParallelSoft-pres.pdf

10 Announcements

tCSC 2022 - announcements May 3 Tuesday.pdf

10:00 Coffee break

11 Modern programming languages for HEP

Parallel and Optimised Scientific Software - lecture 2

• Why Python and C++ ?
• Recent evolutions: C++ 11/14/17
• Modern features of C++ related to performance
• Templating versus inheritance, pros and cons of virtual inheritance
• Python 3, and switching from Python 2

Speaker: Sebastien Ponce (CERN)

Course and exercise sources

ModernProgramming-pres.pdf

12 Technologies and Platforms - exercise

12:20 Lunch

13:00 Study time and/or daily sports

13 Technologies and Platforms - exercise debriefing

Speaker: Andrzej Nowak

14 Optimizing existing large codebase

Parallel and Optimised Scientific Software - lecture 3

• Measuring performance, tools and key indicators
• Improving memory handling
• The nightmare of thread safety
• Code modernization and low level optimizations
• Data structures for efficient computation in modern C++

Speaker: Sebastien Ponce (CERN)

Course and exercise sources

LargeCodeOptimization-pres.pdf

15:20 Coffee break

15 Optimizing existing large codebase - exercise

Optimisation of an existing, production grade large codebase

Speaker: Sebastien Ponce (CERN)

exercise4.pdf

19:30 Dinner (self-organized)

Wednesday 4 May

08:00 Breakfast

16 Scientific computing on heterogeneous architectures

Programming for Heterogeneous Architectures - lecture 1

• Introduction to heterogeneous architectures and the performance challenge
• From general to specialized: Hardware accelerators and applications
• Type of workloads ideal for different accelerators
• Trade-offs between multi-core and many-core architectures
• Implications of heterogeneous hardware on the design and architecture of scientific software
• Embarrassingly parallel scientific applications in HPC and CERN

Speaker: Dorothea Vom Bruch (CPPM/CNRS)

vom_Bruch_scientific_computing_heterogeneous_architectures_2022-05.pdf

17 Announcements

tCSC 2022 - announcements May 4 Wednesday.pptx

10:00 Coffee break

18 Student lightning talks

1-Russo-tCSC_StudentLightning_Russo.pdf

2-Koraka-GPUs-at-CMS_tCSC_2022.pdf

3-Sugunan_CheckboardMetropolis.pdf

4-madlener_podio_edm4hep_tcsc2022.pdf

5-Moravcova_LittleBigBang.pdf

Student lightning talks.pdf

19 Practical vectorization

Parallel and Optimised Scientific Software - lecture 4

• Measuring vectorization level
• What to expect from vectorization
• Preparing code for vectorization
• Vectorizing techniques in C++: intrinsics, libraries, autovectorization

Speaker: Sebastien Ponce (CERN)

Course and exercise sources

PracticalVectorization-pres.pdf

12:20 Lunch

20 School photo

15:00 Outdoor excursion

19:30 Excursion dinner

Thursday 5 May

08:00 Breakfast

21 Programming for GPUs

Programming for Heterogeneous Architectures - lecture 2

• From SIMD to SPMD, a programming model transition
• Thread and memory organization
• Basic building blocks of a GPU program
• Control flow, synchronization, atomics

Speaker: Dorothea Vom Bruch (CPPM/CNRS)

vom_Bruch_programming_for_GPUs_2022-05.pdf

22 Announcements

10:00 Coffee break

23 Performant programming for GPUs

Programming for Heterogeneous Architectures - lecture 3

• Data locality, coalesced memory accesses, tiled data processing
• GPU streams, pipelined memory transfers
• Under the hood: branchless, warps, masked execution
• Debugging and profiling a GPU application

Speaker: Daniel Campora (University of Maastricht)

dcampora_performant_programming_for_gpus_presentation.pdf

24 Practical vectorization - exercise

Speaker: Sebastien Ponce (CERN)

exercise5.pdf

12:20 Lunch

13:00 Study time and/or daily sports

25 Optimisation + vectorization - exercise debriefing

Speaker: Sebastien Ponce (CERN)

26 Design patterns and best practices

Programming for Heterogeneous Architectures - lecture 4

• Good practices: single precision, floating point rounding, avoid register spilling, prefer single source
• Other standards: SYCL, HIP, OpenCL
• Middleware libraries and cross-architecture compatibility
• Reusable parallel design patterns with real-life applications

Speaker: Daniel Campora (University of Maastricht)

dcampora_design_patterns_and_best_practices.pdf

15:40 Coffee break

27 Programming for heterogeneous architectures - exercise

Speakers: Daniel Campora (University of Maastricht), Dorothea Vom Bruch (CPPM/CNRS)

instructions_to_start_gpu_lab.pdf

Where-to-find-GPUs-at-CERN.pdf

19:00 Barbecue dinner

IESC

Friday 6 May

08:00 Breakfast

28 Programming for heterogeneous architectures - exercise

10:00 Coffee break

29 Programming for heterogeneous architectures - exercise

30 Announcements

tCSC 2022 - announcements May 6 Friday.pdf

tCSC 2022 - announcements May 6 Friday.pptx

31 Programming for heterogeneous architectures - exercise debriefing

Speakers: Daniel Hugo Campora Perez (University of Maastricht), Dorothea Vom Bruch (CPPM/CNRS)

12:20 Lunch

13:00 Study time and/or daily sports

32 Summary and future technologies overview

Technologies and Platforms - lecture 4

• Teaching program summary and wrap-up
• Next-generation memory technologies and interconnect
• Future computing evolution

Speaker: Andrzej Nowak

A.Nowak-04 Future Directions and Wrap-up-tCSC2022.pdf

15:20 Coffee break

33 Exam

Exam logistics.pdf

Exam results

16:30 Free time

34 Closing Session

Speaker: Sebastian Lopienski (CERN)

19:30 Closing dinner

Cargèse

Saturday 7 May

08:00 Breakfast

08:30 Departure - bus leaves at 8:30