Sixth Machine Learning in High Energy Physics Summer School 2020

Europe/Berlin
Zoom

Zoom

Andrey Ustyuzhanin (Yandex School of Data Analysis (RU)), Lesya Shchutska (EPFL - Ecole Polytechnique Federale Lausanne (CH))
Description

The Sixth Machine Learning summer school organised by Yandex School of Data AnalysisLaboratory of Methods for Big Data Analysis of National Research University Higher School of Economics, and High Energy Physics Laboratory LPHE at EPFL will be held at EPFL, Lausanne, Switzerland from the 16th to 30th of July 2020.

The school will cover the relatively young area of data analysis and computational research that has started to emerge in High Energy Physics (HEP). It is known by several names including “Multivariate Analysis”, “Neural Networks”, “Classification/Clusterization techniques”. In more generic terms, these techniques belong to the field of “Machine Learning”, which is an area that is based on research performed in Statistics and has received a lot of attention from the Data Science community.

There are plenty of essential problems in high energy physics that can be solved using Machine Learning methods. These vary from online data filtering and reconstruction to offline data analysis.

Students of the school will receive a theoretical and practical introduction to this new field and will be able to apply acquired knowledge to solve their own problems. Topics ranging from decision trees to deep learning and hyperparameter optimisation will be covered with concrete examples and hands-on tutorials. A special data-science competition will be organised within the school to allow participants to get better feeling of real-life ML applications scenarios.

The expected number of students for the school is about 60. The school is aimed at PhD students and postdoctoral researchers, but also open to masters students.

Pre-requisites for participation

Upon completion of the school participants would be able to

  • formulate a HEP-related problem in ML-friendly terms;
  • select quality criteria for a given problem;
  • understand and apply principles of widely-used classification models (e.g. boosting, bagging, BDT, neural networks, etc) to practical cases;
  • optimise features and parameters of a given model in efficient way under given restrictions;
  • select the best classifier implementation amongst a variety of ML libraries (scikit-learn, xgboost, deep learning libraries, etc);
  • understand and apply principles of generative model design;
  • define & conduct reproducible data-driven experiments.

School materials

School materials are available as online course.

Organisers

High Energy Physics Laboratory LPHE at EPFL

Partners

 

Sponsors

Thanks to our sponsors:

CHIPP: Swiss Institute of Particle Physics    Swiss Academy of Sciences  
EPFL Doctoral School
 

 

we can provide a bit of subsidy for students who are not able to afford the full registration fee out of their own funds. Make sure you apply before the early registration deadline. See registration fee page for details. 

    • 9:00 AM 9:30 AM
      Welcome, opening words 30m

      Welcome by organizers, the structure and gist of the school.

      Speaker: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))
    • 9:30 AM 10:00 AM
      Practice. Getting familiar with school infrastructure 30m
      Speakers: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU)), Vladislav Belavin (Yandex School of Data Analysis (RU))
    • 10:00 AM 10:15 AM
      Break 15m
    • 10:15 AM 11:30 AM
      Intro into Machine Intelligence 1h 15m

      Overview of ML history, applications and outlook with HEP perspective.

      Speaker: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))
    • 11:30 AM 12:45 PM
      Section 1. Introduction into ML: Basics
      Convener: Artem Maevskiy (National Research University Higher School of Economics (RU))
      • 11:30 AM
        Introduction into supervised learning 30m

        Practical session

        Speaker: Artem Maevskiy (National Research University Higher School of Economics (RU))
      • 12:00 PM
        Seminar: Data Handling in Python 45m
        Speaker: Artem Maevskiy (National Research University Higher School of Economics (RU))
    • 12:45 PM 1:30 PM
      Lunch 45m
    • 1:30 PM 2:30 PM
      Section 1. Introduction into ML: Linear Regression
      Convener: Artem Maevskiy (National Research University Higher School of Economics (RU))
      • 1:30 PM
        Linear Regression 30m

        Linear regression. Analytical solution. Gradient descent. Numerical solution. Polynomial features.

        Speaker: Artem Maevskiy (National Research University Higher School of Economics (RU))
      • 2:00 PM
        Seminar 30m
        Speaker: Artem Maevskiy (National Research University Higher School of Economics (RU))
    • 2:30 PM 3:00 PM
      Break 30m
    • 3:00 PM 4:00 PM
      Section 1. Introduction into ML: Logistic regression-1
      Convener: Artem Maevskiy (National Research University Higher School of Economics (RU))
      • 3:00 PM
        Logistic regression-1 30m
        Speaker: Artem Maevskiy (National Research University Higher School of Economics (RU))
      • 3:30 PM
        Seminar 30m
    • 4:00 PM 4:30 PM
      Break 30m
    • 4:30 PM 5:30 PM
      Section 1. Introduction into ML: Logistic regression-2
      Convener: Artem Maevskiy (National Research University Higher School of Economics (RU))
      • 4:30 PM
        Logistic regression-2 30m

        Linear models regularization. Probabilistic interpretation of linear models (regression and classification).

        Speaker: Artem Maevskiy (National Research University Higher School of Economics (RU))
      • 5:00 PM
        Seminar 30m
        Speaker: Artem Maevskiy (National Research University Higher School of Economics (RU))
    • 9:00 AM 10:00 AM
      Section 1. Introduction into ML: Quality Metrics-1
      Convener: Mikhail Hushchyn (Yandex School of Data Analysis (RU))
      • 9:00 AM
        Quality Metrics-1 30m

        Quality metrics for classification and regression

        Speaker: Mikhail Hushchyn (Yandex School of Data Analysis (RU))
      • 9:30 AM
        Seminar: Quality Metrics-1 30m
    • 10:00 AM 10:30 AM
      Break 30m
    • 10:30 AM 11:30 AM
      Section 1. Introduction into ML: Quality Metrics-2
      Convener: Mikhail Hushchyn (Yandex School of Data Analysis (RU))
      • 10:30 AM
        Quality Metrics-2 30m

        How to test your model. Cross validation. Statistical model comparison

        Speaker: Mikhail Hushchyn (Yandex School of Data Analysis (RU))
      • 11:00 AM
        Seminar: Quality Metrics-2 30m
        Speaker: Mikhail Hushchyn (Yandex School of Data Analysis (RU))
    • 11:30 AM 12:00 PM
      Break 30m
    • 12:00 PM 1:00 PM
      Section 1. Introduction into ML: Decision trees-1
      Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 12:00 PM
        Decision trees-1 30m

        Splitting rule. Classification and regression decision trees

        Speaker: Mr Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 12:30 PM
        Seminar: Decision trees-1 30m
        Speaker: Nikita Kazeev (Yandex School of Data Analysis (RU))
    • 1:00 PM 2:00 PM
      Lunch 1h
    • 2:00 PM 3:00 PM
      Section 1. Introduction into ML: Ensembles-1
      Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 2:00 PM
        Ensembles-1 30m

        Bagging and Random Forest. Stacking and blending.

        Speaker: Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 2:30 PM
        Seminar: Ensembles-1 30m
        Speaker: Nikita Kazeev (Yandex School of Data Analysis (RU))
    • 3:00 PM 3:30 PM
      Break 30m
    • 3:30 PM 4:30 PM
      Section 1. Introduction into ML: Ensembles-2
      Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 3:30 PM
        Ensembles-2 30m

        Gradient boosting.

        Speaker: Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 4:00 PM
        Seminar: Ensembles-2 30m
        Speaker: Nikita Kazeev (Yandex School of Data Analysis (RU))
    • 4:30 PM 5:00 PM
      Coopetition introduction (1) 30m
      Speaker: Mr Nikita Kazeev (Yandex School of Data Analysis (RU))
    • 5:00 PM 5:30 PM
      Break 30m
    • 5:30 PM 6:30 PM
      Socialization: Open flow discussion
    • 9:00 AM 10:00 AM
      Section 1. Introduction into ML: Useful hacks.
      Convener: Mikhail Hushchyn (Yandex School of Data Analysis (RU))
      • 9:00 AM
        Useful hacks 30m

        Feature engineering, importance and selection.

        Speaker: Mikhail Hushchyn (Yandex School of Data Analysis (RU))
      • 9:30 AM
        Seminar: Useful hacks. 30m
        Speaker: Mikhail Hushchyn (Yandex School of Data Analysis (RU))
    • 10:00 AM 10:30 AM
      Break 30m
    • 10:30 AM 11:30 AM
      Section 1. Introduction into ML: Clustering-1
      Convener: Mikhail Hushchyn (Yandex School of Data Analysis (RU))
      • 10:30 AM
        Clustering-1 30m

        Clustering. K-Means. Quality metrics for clustering

        Speaker: Mikhail Hushchyn (Yandex School of Data Analysis (RU))
      • 11:00 AM
        Seminar: Clustering-1 30m
        Speaker: Mikhail Hushchyn (Yandex School of Data Analysis (RU))
    • 11:30 AM 12:00 PM
      Break 30m
    • 12:00 PM 1:00 PM
      Section 1. Introduction into ML: Clustering-2
      Convener: Mikhail Hushchyn (Yandex School of Data Analysis (RU))
      • 12:00 PM
        Clustering-2 30m

        Hierarchical clustering and DBSCAN.

        Speaker: Mikhail Hushchyn (Yandex School of Data Analysis (RU))
      • 12:30 PM
        Seminar: Clustering-2 30m
        Speaker: Mikhail Hushchyn (Yandex School of Data Analysis (RU))
    • 9:00 AM 5:00 PM
      Sunday 8h
    • 9:00 AM 10:00 AM
      Section 2. Introduction into Neural Networks: Intro to NN
      Convener: Artem Maevskiy (National Research University Higher School of Economics (RU))
      • 9:00 AM
        Intro to NN 20m
        Speaker: Artem Maevskiy (National Research University Higher School of Economics (RU))
      • 9:20 AM
        Seminar: Intro to NN 40m
        Speaker: Artem Maevskiy (National Research University Higher School of Economics (RU))
    • 10:00 AM 10:30 AM
      Break 30m
    • 10:30 AM 11:30 AM
      Section 2. Introduction into Neural Networks: Intro to Pytorch
      Convener: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))
      • 10:30 AM
        Intro to Pytorch 30m
        Speaker: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))
      • 11:00 AM
        Seminar: Pytorch practice 30m
        Speaker: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))
    • 11:30 AM 12:00 PM
      Break 30m
    • 12:00 PM 1:00 PM
      Section 2. Introduction into Neural Networks: CNN
      Convener: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))
      • 12:00 PM
        CNN 30m
        Speaker: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))
      • 12:30 PM
        Seminar: CNN 30m
        Speaker: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))
    • 1:00 PM 2:00 PM
      Lunch 1h
    • 2:00 PM 3:00 PM
      Section 2. Introduction into Neural Networks: Network regularization
      Convener: Artem Maevskiy (National Research University Higher School of Economics (RU))
      • 2:00 PM
        Network regularization 30m
      • 2:30 PM
        Seminar: Network regularization 30m
    • 3:00 PM 3:30 PM
      Break 30m
    • 3:30 PM 4:30 PM
      Section 2. Introduction to Neural Nets: Autoregressive networks
      Convener: Artem Ryzhikov (National Research University Higher School of Economics (RU))
      • 3:30 PM
        Autoregressive networks 30m
      • 4:00 PM
        Seminar: Autoregressive networks 30m
    • 4:30 PM 5:00 PM
      Break 30m
    • 5:00 PM 6:30 PM
      Guest lectures
      Convener: Tommaso Dorigo (Universita e INFN, Padova (IT))
    • 9:00 AM 10:00 AM
      Section 2. Introduction to Neural Nets: Autoregressive networks-2
      Convener: Artem Ryzhikov (National Research University Higher School of Economics (RU))
      • 9:00 AM
        Autoregressive networks-2 30m
      • 9:30 AM
        Seminar: Autoregressive networks-2 30m
    • 10:00 AM 10:30 AM
      Break 30m
    • 10:30 AM 11:30 AM
      Section 2. Introduction to Neural Nets: Network architectures: tips and tricks
      Convener: Maxim Borisyak (Yandex School of Data Analysis (RU))
      • 10:30 AM
        Network architectures: tips and tricks 40m
      • 11:10 AM
        Seminar: Practice 20m
    • 11:30 AM 12:00 PM
      Break 30m
    • 12:00 PM 1:00 PM
      Section 3. Bayesian Deep Learning: Intro
      Convener: Ekaterina Lobacheva
      • 12:00 PM
        Intro 30m
      • 12:30 PM
        Seminar: Intro 30m
    • 1:00 PM 2:00 PM
      Lunch 1h
    • 2:00 PM 3:00 PM
      Section 3. Bayesian Deep Learning: Full Bayesian Inference
      Convener: Ekaterina Lobacheva
      • 2:00 PM
        Full Bayesian Inference 30m
      • 2:30 PM
        Seminar: Full Bayesian Inference 30m
    • 3:00 PM 3:30 PM
      Break 30m
    • 3:30 PM 4:00 PM
      Section 3. Bayesian Deep Learning: Bayesian linear regression
      Convener: Nadya Chirkova
    • 4:00 PM 4:30 PM
      Break 30m
    • 4:30 PM 6:00 PM
      Guest lectures
    • 9:00 AM 10:00 AM
      Section 3. Bayesian Deep Learning: Variational Inference
      Convener: Ekaterina Lobacheva
      • 9:00 AM
        Variational Inference 30m
      • 9:30 AM
        Seminar: Variational Inference 30m
    • 10:00 AM 10:30 AM
      Break 30m
    • 10:30 AM 11:30 AM
      Section 3. Bayesian Deep Learning: Gaussian Processes
      Convener: Nadya Chirkova
    • 11:30 AM 12:00 PM
      Break 30m
    • 12:00 PM 1:30 PM
      Section 3. Bayesian Deep Learning: Bayesian Neural Networks
      Convener: Nadya Chirkova
      • 12:00 PM
        Bayesian Neural Networks - Introduction 30m
      • 12:30 PM
        Bayesian Neural Networks - Training 30m
    • 1:30 PM 2:30 PM
      Lunch 1h
    • 2:30 PM 3:30 PM
      Section 3. Bayesian Deep Learning: Bayesian Neural Networks
      Convener: Nadya Chirkova
      • 2:30 PM
        Seminar: Bayesian Neural Networks - Training 30m
      • 3:00 PM
        Bayesian Sparsification of Neural Networks 30m
    • 3:30 PM 4:00 PM
      Break 30m
    • 4:00 PM 4:30 PM
      Introduction into the 2nd coopetition 30m
      Speaker: Artem Maevskiy (National Research University Higher School of Economics (RU))
    • 4:30 PM 6:00 PM
      Guest lectures
    • 9:00 AM 10:00 AM
      Section 3. Bayesian Deep Learning: VAE
      • 9:00 AM
        VAE 30m
      • 9:30 AM
        Seminar: VAE 30m
    • 10:00 AM 10:30 AM
      Section 3. Bayesian Deep Learning: Seminar: VAE
      Convener: Alexei Struminsky (Space Research Institute)
    • 10:30 AM 11:00 AM
      Break 30m
    • 11:00 AM 11:30 AM
      Section 4. Generative models and networks: Generative models
      Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))
    • 11:30 AM 12:00 PM
      Section 4. Generative models and networks: Seminar: Practice on basic generative models
      Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))
    • 12:00 PM 12:30 PM
      Break 30m
    • 12:30 PM 1:00 PM
      Section 4. Generative models and networks: Introduction to distances Pt. 1
      Convener: Vladislav Belavin (Yandex School of Data Analysis (RU))
    • 1:00 PM 1:30 PM
      Section 4. Generative models and networks: Seminar: Distances Pt. 1
      Convener: Vladislav Belavin (Yandex School of Data Analysis (RU))
    • 1:30 PM 2:30 PM
      Lunch 1h
    • 2:30 PM 3:00 PM
      Section 4. Generative models and networks: Introduction to distances Pt. 2
      Convener: Vladislav Belavin (Yandex School of Data Analysis (RU))
    • 3:00 PM 3:30 PM
      Section 4. Generative models and networks: Seminar: Distances Pt. 2
      Convener: Vladislav Belavin (Yandex School of Data Analysis (RU))
    • 3:30 PM 4:00 PM
      Break 30m
    • 4:00 PM 5:30 PM
      Guest lectures
    • 9:00 AM 10:00 AM
      Section 4. Generative models and networks: Autoencoders
      Convener: Artem Ryzhikov (National Research University Higher School of Economics (RU))
      • 9:00 AM
        Autoencoders 30m
      • 9:30 AM
        Seminar: Practice on AE 30m
    • 10:00 AM 10:30 AM
      Break 30m
    • 10:30 AM 11:30 AM
      Section 4. Generative models and networks: GANs
      Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 10:30 AM
        GANs 30m
      • 11:00 AM
        Seminar: GANs 30m
    • 11:30 AM 12:00 PM
      Break 30m
    • 12:00 PM 1:00 PM
      Section 4. Generative models and networks: Advanced GANs
      Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 12:00 PM
        Advanced GANs 30m
      • 12:30 PM
        Seminar: Advanced GANs 30m
    • 1:00 PM 2:00 PM
      Lunch 1h
    • 2:00 PM 3:00 PM
      Section 4. Generative models and networks: Flow models
      Convener: Artem Ryzhikov (National Research University Higher School of Economics (RU))
      • 2:00 PM
        Flow models 30m
      • 2:30 PM
        Seminar: Flow models 30m
    • 3:00 PM 3:30 PM
      Break 30m
    • 3:30 PM 4:30 PM
      Section 4. Generative models and networks: Invertible Generative Models
      • 3:30 PM
        Invertible Generative Models 30m
      • 4:00 PM
        Seminar: Invertible Generative Practice 30m
    • 4:30 PM 5:00 PM
      Break 30m
    • 5:00 PM 6:30 PM
      Guest lectures
    • 9:00 AM 10:00 AM
      Section 5. Advanced Optimization Methods: Introduction to black-box optimization
      Convener: Maxim Borisyak (Yandex School of Data Analysis (RU))
      • 9:00 AM
        Introduction to black-box optimization 30m
      • 9:30 AM
        Seminar: Introduction to black-box optimization 30m
    • 10:00 AM 10:30 AM
      Break 30m
    • 10:30 AM 11:30 AM
      Section 5. Advanced Optimization Methods: Variational Optimization
      Convener: Mr Vladislav Belavin (Yandex School of Data Analysis (RU))
    • 11:30 AM 12:00 PM
      Break 30m
    • 12:00 PM 1:30 PM
      Guest lectures
    • 9:00 AM 10:00 AM
      Section 5. Advanced Optimization Methods: Bayesian Optimization
      Convener: Maxim Borisyak (Yandex School of Data Analysis (RU))
      • 9:00 AM
        Bayesian Optimization 30m
      • 9:30 AM
        Seminar: Bayesian Optimization 30m
    • 10:00 AM 10:30 AM
      Break 30m
    • 10:30 AM 11:30 AM
      Section 5. Advanced Optimization Methods: BO-GP and friends-1
      Convener: Maxim Borisyak (Yandex School of Data Analysis (RU))
      • 10:30 AM
        BO-GP and friends 30m
      • 11:00 AM
        Seminar: BO-GP and friends 30m
    • 11:30 AM 12:00 PM
      Break 30m
    • 12:00 PM 1:00 PM
      Section 5. Advanced Optimization Methods: BO-GP and friends-2
      Convener: Maxim Borisyak (Yandex School of Data Analysis (RU))
      • 12:00 PM
        BO-GP and friends 30m
      • 12:30 PM
        Seminar: BO-GP and friends 30m
    • 1:00 PM 2:00 PM
      Lunch 1h
    • 2:00 PM 3:30 PM
      Guest lectures
    • 3:30 PM 4:00 PM
      Break 30m
    • 4:00 PM 5:00 PM
      Socialization: Open flow discussion
    • 9:00 AM 10:00 AM
      Section X: Learning to pivot
      Convener: Maxim Borisyak (Yandex School of Data Analysis (RU))
      • 9:00 AM
        Learning to pivot 20m
      • 9:20 AM
        Seminar: Learning to pivot 40m
    • 10:00 AM 10:30 AM
      Break 30m
    • 10:30 AM 12:30 PM
      Section X: Deep Learning at scale
    • 12:30 PM 1:30 PM
      Lunch 1h
    • 1:30 PM 2:30 PM
      Section X: Interpretability
    • 2:30 PM 3:00 PM
      Break 30m
    • 3:00 PM 4:30 PM
      Guest lectures
      Convener: Michael Aaron Kagan (SLAC National Accelerator Laboratory (US))
    • 4:30 PM 5:00 PM
      Break 30m
    • 5:00 PM 6:30 PM
      Guest Lecture 1h 30m
      Speaker: Dr Michela Paganini (Facebook AI Research)
    • 9:00 AM 10:00 AM
      Section X: Anomaly Detection-1
      Convener: Denis Derkach (National Research University Higher School of Economics (RU))
    • 10:00 AM 10:30 AM
      Break 30m
    • 10:30 AM 11:30 AM
      Section X: Anomaly Detection-2
      Convener: Denis Derkach (National Research University Higher School of Economics (RU))
    • 11:30 AM 12:00 PM
      Break 30m
    • 12:00 PM 1:30 PM
      Guest lectures
    • 1:30 PM 2:30 PM
      Lunch 1h
    • 2:30 PM 4:00 PM
      Break 1h 30m
    • 4:00 PM 5:30 PM
      Guest lectures
      • 4:00 PM
        Lunch 1h
    • 9:00 AM 10:30 AM
      Guest lectures
    • 10:30 AM 11:30 AM
      Break 1h
    • 11:30 AM 1:00 PM
      Socialization: Student's project presentations
    • 1:00 PM 1:30 PM
      Closing words 30m
      Speaker: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))
    • 1:30 PM 2:30 PM
      Lunch 1h
    • 2:30 PM 4:30 PM
      Socialization: Follow-up (VR?) party