US ATLAS Machine Learning Training 2023

US/Pacific
59/3101 (Building 59) (LBNL)

59/3101 (Building 59)

LBNL

1 Cyclotron Rd, Berkeley, CA 94720
Aishik Ghosh (University of California Irvine (US)), Elham E Khoda (University of Washington (US)), Ben Nachman (Lawrence Berkeley National Lab. (US))
Description

 

The second iteration of the US ATLAS Machine Learning (ML) training event will be hosted at Lawrence Berkeley National Laboratory. All talks and tutorials will be given in person. The workshop is open to all ATLAS collaborators.

Overview:

We will introduce fundamental concepts of machine learning accompanied by hands-on tutorials of the essential open-source ML packages. The program will cover particle physics specific use cases and deployment of the trained models in Athena/FPGAs, with lots of hands-on examples. There will be invited talks from ATLAS members who have previously deployed ML for different tasks in ATLAS, as well as experts from CMS adn beyond. Use cases in other experiments and other scientific domains will also be discussed to provide a glimpse into the larger ML4Science world.

Attendees can expect to gain an overview of the broad range of current and potential ML applications in ATLAS, and also learn some of the particle physics specific tricks that an ML practitioner picks up from experience. We will try to address the typical ML questions that often come up in ATLAS meetings.

Tentative topics to be covered:

  • Introduction to Machine Learning
  • Introduction to standard open-source ML packages like Scikit-learn, XGBoost, Keras and Pytorch (hands-on)
  • Overview of ML in particle physics
  • Practitioners guide to handling particle physics datasets
  • Generative Models (hands-on)
  • Uncertainty treatment
  • Unfolding
  • Simulator Based Inference
  • Exploiting symmetries in physics data (hands-on)
  • Graph Neural Networks in particle physics (hands-on)
  • Transformers and LLMs
  • Differentiable Programming (hands-on)
  • Deploying NNs in C++ and python: ONNX Runtime (hands-on)
  • Deploying NNs on FPGA: Quantization, Model prunnning and compression, HLS4ML (hands-on)

Please look at the time table to for the full agenda.

Industry Talk:

This year we will have Chen Luo from Amazon talk to us about his experience working in industry.

Computing Resources:

In-person participants will be guaranteed computing resources for the hands-on sessions thanks to NERSC. Virtual participants will be giving access on a first come first serve basis. 

Networking:

The inaugural program led to new collaborative proejcts in ATLAS. This training program will again be a platform for young ML enthusiasts to connect with one another and with veteran ML experts in ATLAS.

Tutorial git:

Github link: https://github.com/usatlas-ml-training/lbnl-2023/tree/main 

Zoom: 

Discussions:
Join the slack workspace to discuss and ask questions about the tutorials, particularly for remote participants.

slack joining link:

Participants
  • Andrej Saibel
  • Bradley Duane Hutchinson
  • Camila Pazos
  • Christian Weber
  • CONNOR WAITS
  • Danijela Bogavac
  • Diptaparna Biswas
  • Egor Antipov
  • Elham E Khoda
  • Hui-Chi Lin
  • Ilkay Turk Cakir
  • Jack Harrison
  • Jason Gombas
  • Joni Pham
  • Juan Carlos Cardenas Jr
  • Judita Mamuzic
  • Juerg Beringer
  • Luis Felipe Gutierrez
  • Luke Martin Vaughan
  • Marco Lisboa Leite
  • Mario Campanelli
  • Mason Ray Housenga
  • Matthew Drnevich
  • Meng-Ju Tsai
  • Mohamed Belfkir
  • Mohamed Reda MEKOUAR
  • Ning Ni
  • Qiuping Shen
  • Rebecca Hicks
  • Ricardo Barrué
  • Rodrigo Estevam De Paula
  • Saad Mohiuddin
  • Stergios Kazakos
  • Tom Cheng
  • Wasikul Islam
  • Zackary Lee Alegria
  • Zekeriya Uysal
  • Zubair Bhatti
  • +54
    • 1
      Welcome Presentation 59/4102

      59/4102

      LBNL

      Speakers: Aishik Ghosh (University of California Irvine (US)), Ben Nachman (Lawrence Berkeley National Lab. (US)), Elham E Khoda (University of Washington (US))
    • 2
      Introduction to Machine Learning: Part I 59/4102 (Building 59)

      59/4102

      Building 59

      Speaker: Javier Mauricio Duarte (Univ. of California San Diego (US))
    • 10:30 AM
      Break 59/4102 (Building 59)

      59/4102

      Building 59

    • 3
      Tutorial: ML Tools and Techniques 59/4102 (Building 59)

      59/4102

      Building 59

      Speakers: Jay Chan (University of Wisconsin Madison (US)), Kehang Bai (University of Oregon (US))
    • 12:30 PM
      Lunch (on your own)
    • 4
      Introduction to Machine Learning: Part II 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
      Speaker: Elham E Khoda (University of Washington (US))
    • 3:30 PM
      Break 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
    • 5
      Tutorial: Neural Networks 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
      Speakers: Jay Chan (University of Wisconsin Madison (US)), Kehang Bai (University of Oregon (US))
    • 6
      Overview of ML in particle physics 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
      Speaker: Ben Nachman (Lawrence Berkeley National Lab. (US))
    • 10:30 AM
      Coffee Break 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
    • 7
      Graph NN: part I 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
      Speaker: Javier Mauricio Duarte (Univ. of California San Diego (US))
    • 12:30 PM
      Lunch (on your own)
    • 8
      Graph NN: Part II 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
      Speaker: Javier Mauricio Duarte (Univ. of California San Diego (US))
    • 9
      Generative Models: Part I 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
      Speakers: Sascha Diefenbacher (Lawrence Berkeley National Lab. (US)), Vinicius Massami Mikuni (Lawrence Berkeley National Lab. (US))
    • 3:45 PM
      Coffee Break 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
    • 10
      Generative Models: Part II 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
      Speakers: Sascha Diefenbacher (Lawrence Berkeley National Lab. (US)), Vinicius Massami Mikuni (Lawrence Berkeley National Lab. (US))
    • 11
      Uncertainties 59/4102 (Building 59)

      59/4102

      Building 59

      Speaker: Aishik Ghosh (University of California Irvine (US))
    • 10:00 AM
      Coffee Break 59/4102 (Building 59)

      59/4102

      Building 59

    • 12
      Unfolding 59/4102 (Building 59)

      59/4102

      Building 59

      Speaker: Vinicius Massami Mikuni (Lawrence Berkeley National Lab. (US))
    • 12:00 PM
      Lunch (on your own)
    • 13
      Differentiable Programming with JAX 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
      Speakers: Arnur Nigmetov (LBNL), Nithin Chalapathi (University of California, Berkeley)
    • 3:30 PM
      Coffee Break 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
    • 14
      Industry Talk 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
      Speaker: Dr Chen Luo (Amazon.com)
    • 15
      Networking 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
    • 6:00 PM
      Dinner (Jupiter Restaurant, Downtown Berkeley) 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
    • 16
      Transformers 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
      Speaker: Alexander Shamakov (UC Irvine)
    • 10:00 AM
      Coffee Break 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
    • 17
      Software deployment with ONNXRuntime 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
      Speaker: Dhanush Anil Hangal (Lawrence Livermore Nat. Laboratory (US))
    • 12:00 PM
      Lunch (on your own)
    • 18
      Hardware deployment with hls4ml 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720

      Step 1:
      Accept the github invitation (sent earlier today)

      Step 2:
      Start the jupyterhub: https://jhub.35.192.180.88.nip.io

      Speaker: Elham E Khoda (University of Washington (US))
    • 3:00 PM
      Coffee Break 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
    • 19
      Large Language Models 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
      Speaker: Xiangyang Ju (Lawrence Berkeley National Lab. (US))
    • 20
      Closing Remarks 59/3101 (Building 59)

      59/3101 (Building 59)

      LBNL

      1 Cyclotron Rd, Berkeley, CA 94720
      Speakers: Aishik Ghosh (University of California Irvine (US)), Ben Nachman (Lawrence Berkeley National Lab. (US)), Elham E Khoda (University of Washington (US))