Fourth Machine Learning in High Energy Physics Summer School 2018

Europe/London
St Anne's College, Mary Ogilvie LT (University of Oxford)

St Anne's College, Mary Ogilvie LT

University of Oxford

56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
Andrey Ustyuzhanin (Yandex School of Data Analysis (RU)) , Miha Zgubic (University of Oxford (GB))
Description

The Fourth Machine Learning summer school organised by Yandex School of Data AnalysisLaboratory of Methods for Big Data Analysis of National Research University Higher School of Economics and University of Oxford will be held in Oxford, UK from 6 to 12 August 2018.

The school will cover the relatively young area of data analysis and computational research that has started to emerge in High Energy Physics (HEP). It is known by several names including “Multivariate Analysis”, “Neural Networks”, “Classification/Clusterization techniques”. In more generic terms, these techniques belong to the field of “Machine Learning”, which is an area that is based on research performed in Statistics and has received a lot of attention from the Data Science community.

There are plenty of essential problems in high energy physics that can be solved using Machine Learning methods. These vary from online data filtering and reconstruction to offline data analysis.

Students of the school will receive a theoretical and practical introduction to this new field and will be able to apply acquired knowledge to solve their own problems. Topics ranging from decision trees to deep learning and hyperparameter optimisation will be covered with concrete examples and hands-on tutorials. A special data-science competition will be organised within the school to allow participants to get better feeling of real-life ML applications scenarios.

Expected number of students for the school is 50-60 people. The school is aimed at PhD students and postdoctoral researchers, but also open to masters students.

Pre-requisites for participation

Upon completion of the school participants would be able to

  • formulate a HEP-related problem in ML-friendly terms;
  • select quality criteria for a given problem;
  • understand and apply principles of widely-used classification models (e.g. boosting, bagging, BDT, neural networks, etc) to practical cases;
  • optimise features and parameters of a given model in efficient way under given restrictions;
  • select the best classifier implementation amongst a variety of ML libraries (scikit-learn, xgboost, deep learning libraries, etc);
  • understand and apply principles of generative model design;
  • define & conduct reproducible data-driven experiments.

School competition

Details on the school Machine Learning competition are provided on the dedicated page.

School materials

School materials are available on github.

Join the Telegram chat via this link.

Organisers

Partners

Sponsors

We can provide a bit of subsidy for students who are not able to afford the full registration fee out of their own funds. Make sure you apply before the early registration deadline. See registration fee page for details. 

INSIGHTS is funded by the European Union’s Horizon 2020 research and innovation programme,
call H2020-MSCA-ITN-2017, under Grant Agreement n. 765710
    • 08:50 09:00
      Organisational: Opening words St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Conveners: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU)) , Miha Zgubic (University of Oxford (GB))
    • 09:00 10:30
      Lectures: Day 1 Lectures (Track 1) St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Maxim Borisyak (Yandex School of Data Analysis (RU))
      • 09:00
        Track 1 Lecture. Overfitting. Model Selection. Figures of Merits. Linear Models. Regularization. Logistic Regression. 1h 30m
        Speaker: Maxim Borisyak (Yandex School of Data Analysis (RU))
    • 09:00 10:30
      Lectures: Day 1 Lectures (Track 2) St Anne’s College, Mary Ogilvie LT, University of Oxford

      St Anne’s College, Mary Ogilvie LT, University of Oxford

      Convener: Alexey Artemov (Yandex)
      • 09:00
        Track 2 Lecture. Ensembling: Stacking, RandomForest, AdaBoost, Gradient Boosting. 1h 30m
        Speaker: Alexey Artemov (Yandex)
    • 10:30 11:00
      Coffee break 30m St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 11:00 12:30
      Seminars: Day 1 Seminars (Track 1) St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Maxim Borisyak (Yandex School of Data Analysis (RU))
      • 11:00
        Track 1 Seminar. Introduction into Decision Trees. Python ML stack recap (numpy, scikit-learn, pandas). 1h 30m
        Speaker: Maxim Borisyak (Yandex School of Data Analysis (RU))
    • 11:00 12:30
      Seminars: Day 1 Seminars (Track 2) St Anne’s College, Mary Ogilvie LT, University of Oxford

      St Anne’s College, Mary Ogilvie LT, University of Oxford

      Convener: Alexey Artemov (Yandex)
      • 11:00
        Track 2 Seminar. Tree Ensembles in practice. 1h 30m
        Speaker: Alexey Artemov (Yandex)
    • 12:30 13:30
      Organisational: Lunch St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 13:30 15:00
      Lectures: Day 1 Lectures (Track 1) St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 13:30
        Track 1 Lecture. Ensembling: Stacking, RandomForest, AdaBoost, Gradient Boosting. 1h 30m
        Speaker: Nikita Kazeev (Yandex School of Data Analysis (RU))
    • 13:30 15:00
      Lectures: Day 1 Lectures (Track 2) St Anne’s College, Mary Ogilvie LT, University of Oxford

      St Anne’s College, Mary Ogilvie LT, University of Oxford

      Convener: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))
      • 13:30
        Track 2 Lecture. Dimensionality reduction. 1h 30m
        Speaker: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))
    • 15:00 15:30
      Coffee break 30m St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 15:30 17:00
      Seminars: Day 1 Seminars (Track 1) St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 15:30
        Track 1 Seminar. Tree Ensembles in practice 1h 30m
        Speaker: Nikita Kazeev (Yandex School of Data Analysis (RU))
    • 15:30 17:00
      Seminars: Day 1 Seminars (Track 2) St Anne’s College, Mary Ogilvie LT, University of Oxford

      St Anne’s College, Mary Ogilvie LT, University of Oxford

      • 15:30
        Track 2 Seminar. Graph methods. 1h 30m
    • 17:00 17:20
      Practice: Competition Introduction St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))
      • 17:00
        Competition Introduction 20m
        Speaker: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))
    • 17:20 18:50
      Invited talk: Accelerating searches for new physics (and Dark Matter) with Machine Learning St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Sascha Caron (Nikhef National institute for subatomic physics (NL))
    • 19:00 20:30
      Organisational: Welcome Reception St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 09:00 10:30
      Lectures: Day 2 Lectures St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Alexey Artemov (Yandex)
      • 09:00
        Lecture. Introduction into Neural Network models. Multi-layered Perceptron. Backpropagation. 1h 30m
        Speaker: Alexey Artemov (Yandex)
    • 10:30 11:00
      Coffee break 30m St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 11:00 12:30
      Seminars: Day 2 Seminars St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Alexey Artemov (Yandex)
      • 11:00
        Seminar. Computing gradient by hand. Keras. 1h 30m
        Speaker: Alexey Artemov (Yandex)
    • 12:30 13:30
      Organisational: Lunch St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 13:30 15:00
      Lectures: Day 2 Lectures St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Alexey Artemov (Yandex)
      • 13:30
        Lecture. Intro into Deep learning. Convolutional Neural Network. 1h 30m
        Speaker: Alexey Artemov (Yandex)
    • 15:00 15:30
      Coffee break 30m St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 15:30 17:00
      Seminars: Day 2 seminrs St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Alexey Artemov (Yandex)
      • 15:30
        Seminar. Image recognition using convolutional neural networks. 1h 30m
        Speaker: Alexey Artemov (Yandex)
    • 17:00 17:15
      Organisational: Break St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 17:15 18:45
      Invited talk: Fuelling the Artificial Intelligence Revolution with Gaming (Alison Lowndes, Nvidia) St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 19:00 19:40
      Extra session on gradient boosting (optional) 40m St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Speaker: Maxim Borisyak (Yandex School of Data Analysis (RU))
    • 09:00 21:00
      Free day St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 11:00 13:00
      Free day: Walking tour of Oxford Broad Street

      Broad Street

    • 14:00 15:00
      Free day: Oxford Union tour: A-D St Michael's Street

      St Michael's Street

    • 15:00 16:00
      Free day: Oxfordu Union tour: E-Mc St Michael's Street

      St Michael's Street

    • 16:00 17:00
      Free day: Oxford Union tour: Me-Z St Michael's Street

      St Michael's Street

    • 09:00 10:30
      Lectures: Day 4 Lectures St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 09:00
        Lecture. Probability density estimation. Variational Autoencoder. 1h 30m
        Speaker: Nikita Kazeev (Yandex School of Data Analysis (RU))
    • 10:30 11:00
      Coffee break 30m St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 11:00 12:30
      Seminars: Day 4 Seminars St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 11:00
        Seminar. Tensorflow, Variational Autoencoder. 1h 30m
        Speaker: Nikita Kazeev (Yandex School of Data Analysis (RU))
    • 12:30 13:30
      Organisational: Lunch St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 13:30 15:00
      Lectures: Day 4 Lectures St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 13:30
        Lecture. Generative Adversarial Networks. 1h 30m
        Speaker: Nikita Kazeev (Yandex School of Data Analysis (RU))
    • 15:00 15:30
      Coffee break 30m St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 15:30 17:00
      Seminars: Day 4 Seminars St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 15:30
        Seminar. Generative Adversarial Networks. 1h 30m
        Speaker: Nikita Kazeev (Yandex School of Data Analysis (RU))
    • 17:00 17:15
      Organisational: Break St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 17:15 18:15
      Invited talk: What makes tensorflow fast? (Peter Braam, Braam Research LLC) St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 08:30 09:00
      Lectures: Neural networks for Network structures (MPNN) St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))
    • 09:00 10:30
      Lectures: Day 5 Lectures St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Maxim Borisyak (Yandex School of Data Analysis (RU))
      • 09:00
        Lecture. Black-box optimization: Bayesian Optimization, Variational Optimization. 1h 30m
        Speaker: Maxim Borisyak (Yandex School of Data Analysis (RU))
    • 10:30 11:00
      Coffee break 30m St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 11:00 12:30
      Seminars: Day 5 Seminars St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Maxim Borisyak (Yandex School of Data Analysis (RU))
      • 11:00
        Seminar. Hyper-parameter optimization. 1h 30m
        Speaker: Maxim Borisyak (Yandex School of Data Analysis (RU))
    • 12:30 13:30
      Organisational: Lunch St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 13:30 15:00
      Lectures: Day 5 Lectures St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Maxim Borisyak (Yandex School of Data Analysis (RU))
      • 13:30
        Lecture. Adversarial Optimization (in general), Adversarial Variational Optimization. 1h 30m
        Speaker: Maxim Borisyak (Yandex School of Data Analysis (RU))
    • 15:00 15:30
      Coffee break 30m St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 15:30 17:00
      Seminars: Day 5 Seminars St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Maxim Borisyak (Yandex School of Data Analysis (RU))
      • 15:30
        Seminar. Tuning PYTHIA. 1h 30m
        Speaker: Maxim Borisyak (Yandex School of Data Analysis (RU))
    • 17:00 17:15
      Organisational: Break St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 17:15 18:45
      Invited talk: Applied machine learning in marketing tech: Data driven advertising at the petabyte scale. (Alex Sadovsky, Oracle) St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 19:00 19:45
      Drinks Reception 45m Somerville College

      Somerville College

    • 19:45 21:45
      School Dinner 2h Somerville College

      Somerville College

      School dinner at Somerville College.

    • 09:00 10:30
      Lectures: Day 6 Lectures St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))
      • 09:00
        Lecture. Domain Adaptation (reweighting, flatness, adversarial DA). 1h 30m
        Speaker: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))
    • 10:30 11:00
      Coffee break 30m St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 11:00 12:30
      Seminars: Day 6 Seminars St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Dr Alexey Artemov (Skoltech, HSE)
      • 11:00
        Seminar. NN interpretation. Tips & tweaks. 1h 30m
        Speaker: Dr Alexey Artemov (Skoltech, HSE)
    • 12:30 13:30
      Organisational: Lunch St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 13:30 15:00
      Lectures: Day 6 Lectures. St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      • 13:30
        Lecture. RNN: GRU + LSTM + Jet recognition. 1h 30m
    • 15:00 15:30
      Coffee break 30m St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 15:30 17:00
      Invited talk: Deep Learning in High Energy Physics. St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
      Convener: Michael Aaron Kagan (SLAC National Accelerator Laboratory (US))
    • 17:00 17:15
      Organisational: Break St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 17:15 18:45
      Invited talk: Few-shot Generative Modelling with Generative Matching Networks (Sergey Bartunov, DeepMind) St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.
    • 09:00 10:30
      Organisational: Competition and school wrap-up. St Anne's College, Mary Ogilvie LT

      St Anne's College, Mary Ogilvie LT

      University of Oxford

      56 Woodstock Rd, Oxford OX2 6HS, United Kingdom.