Second Machine Learning in High Energy Physics Summer School 2016

Europe/Copenhagen
Lundmarkssalen (Lund University)

Lundmarkssalen

Lund University

Lund University, Lund, Sweden
Andrey Ustyuzhanin (Yandex School of Data Analysis (RU)), Caterina Doglioni (Lund University (SE))
Description

The Second Machine Learning summer school organized by Yandex School of Data Analysis and Laboratory of Methods for Big Data Analysis of National Research University Higher School of Economics will be held in Lund, Sweden from 20 to 26 June 2016. It is hosted by Lund University.

The school is intended to cover the relatively young area of data analysis and computational research that has started to emerge in High Energy Physics (HEP). It is known by several names including “Multivariate Analysis”, “Neural Networks”, “Classification/Clusterization techniques”. In more generic terms, these techniques belong to the field of “Machine Learning”, which is an area that is based on research performed in Statistics and has received a lot of attention from the Data Science community.

There are plenty of essential problems in High energy Physics that can be solved using Machine Learning methods. These vary from online data filtering and reconstruction to offline data analysis.

Students of the school will receive a theoretical and practical introduction to this new field and will be able to apply acquired knowledge to solve their own problems. Topics ranging from decision trees to deep larning and hyperparameter optimization will be covered with concrete examples and hands-on tutorials. A special data-science competition will be organized within the school to allow participants to get better feeling of real-life ML applications scenarios.

The MLHEP school is a satellite event to the LHCP2016 conference, so its dates and venue (Lund University) are well-aligned with the conference.

Expected number of students for the school is 40-50 people.

Pre-requisites for participation

Upon completion of the school participants would be able to

  • formulate a HEP-related problem in ML-friendly terms
  • select quality criteria for a given problem
  • understand and apply principles of widely-used classification models (e.g. boosting, bagging, BDT, neural networks, etc) to practical cases
  • optimize features and parameters of a given model in efficient way under given restrictions
  • select the best classifier implementation amongst a variety of ML libraries (scikit-learn, xgboost, deep learning libraries, etc)
  • define & conduct reproducible data-driven experiments

Github repository, with material and slides from the school

https://github.com/yandexdataschool/mlhep2016

Organizers

Partners

Local information
Registration
Accommodation & dinners
    • 09:00 10:20
      Organisational: Welcome Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
      Convener: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))
      • 09:00
        Registration 30m
      • 09:30
        Welcome to MLHEP 20m
        Speaker: Caterina Doglioni (Lund University (SE))
      • 09:50
        Competition introduction 15m
      • 10:05
        Break 15m
    • 10:20 13:20
      Lectures: Day 1 lectures Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
      Convener: Aleksei Rogozhnikov (Yandex School of Data Analysis (RU))
      • 10:20
        Intro: General pipeline, ML at a glance, model evaluation 1h 20m

        Featuring cross-validation and ROC AUC

      • 11:40
        Break 20m
      • 12:00
        Metric ML algorithms 1h 20m

        SVM, KNN, Linear regression

    • 13:20 14:35
      Organisational: Lunch Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
    • 14:35 17:35
      Seminars: Day 1 seminars Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
      Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 14:35
        Course technicalities, working environment 1h 20m
      • 15:55
        Break 20m
      • 16:15
        Python for data analysis; Probability density estimation 1h 20m

        numpy, root_numpy, pandas, matplotlib

    • 17:35 17:55
      Organisational: Break Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
    • 17:55 19:00
      Invited lectures: Jet parton and particle identification and applications Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
      Convener: J Michael Williams (Massachusetts Inst. of Technology (US))
    • 20:00 21:30
      Organisational: Welcome dinner http://www.stadsparkscafeet.se/

      http://www.stadsparkscafeet.se/

      Stadsparken i Lund Stadsparksgången 222 29
    • 09:30 12:30
      Lectures: Day 2 lectures Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
      Convener: Aleksei Rogozhnikov (Yandex School of Data Analysis (RU))
      • 09:30
        Decision trees 1h 20m
      • 10:50
        Break 20m
      • 11:10
        Ensembles 1h 20m

        bagging & boosting

    • 12:30 13:30
      Organisational: Lunch Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
    • 13:30 16:30
      Seminars: Day 2 seminrs Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
      Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 13:30
        Model evaluation 1h 20m

        Overfitting, Cross-validation

      • 14:50
        Break 20m
      • 15:10
        sklearn, simple algorithms 1h 20m
    • 16:30 16:50
      Organisational: Break Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
    • 16:50 18:00
      Invited lectures: Online, Collaborative Machine Learning Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
      Convener: Dr Joaquin Vanschoren (Eindhoven University of Technology)
    • 09:30 12:30
      Lectures: Day 3 lectures Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
      Convener: Aleksei Rogozhnikov (Yandex School of Data Analysis (RU))
      • 09:30
        Feature engineering, Dimensionality reduction 1h 20m
      • 10:50
        Break 20m
    • 12:30 13:30
      Organisational: Lunch Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
    • 13:30 15:10
      Seminars: Day 3 seminars Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
      Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 13:30
        Ensemble algorithms, dimensionality reduction 1h 20m

        Random forest, gradient boosting, PCA

      • 14:50
        Break 20m
    • 15:10 16:10
      Invited lectures: Data Doping solution to the "Flavour of Physics" Kaggle challenge Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
      Convener: Dr Vicens Gaitan (Grupo AIA R&D Director)
    • 16:10 16:30
      Organisational: Break Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
    • 16:30 17:30
      Invited lectures: Approximating Likelihood Ratios with Calibrated Classifiers (TBC) Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
      Convener: Gilles Louppe (New York University (US))
    • 09:30 11:10
      Lectures: Day 4 lectures Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
      Convener: Tatiana Likhomanenko (National Research Centre Kurchatov Institute (RU))
      • 09:30
        Boosting reweighting and flatness 1h 20m
      • 10:50
        Break 20m
    • 11:10 12:30
      Seminars: Boosting reweighting and flatness - seminar Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
      Convener: Tatiana Likhomanenko (National Research Centre Kurchatov Institute (RU))
    • 12:30 13:30
      Organisational: Lunch Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
    • 14:00 19:20
      Seminars: Day 4 seminars H418, RYDBERGSALEN (Lund Univeristy)

      H418, RYDBERGSALEN

      Lund Univeristy

      Sölvegatan 14, 223 62 Lund
      • 14:00
        Feature engineering and selection 1h 20m

        Flatness boosting and reweighting

        Speaker: Nikita Kazeev (Yandex School of Data Analysis (RU))
      • 15:20
        Break 20m
      • 15:40
        Shallow neural networks 1h 20m
        Speaker: Alexander Panin (Yandex School of Data Analysis (RU))
      • 17:00
        Break 20m
      • 17:20
        Deep neural networks 2h
        Speaker: Alexander Panin (Yandex School of Data Analysis (RU))
    • 09:00 21:00
      Midsommar Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden

      From https://sweden.se/culture-traditions/midsummer/ In mid-June, school is out and nature has burst into life. It seems like the sun never sets. In fact, in the north of Sweden it doesn’t, and in the south only for an hour or two. This calls for celebration! Friends and family gather for the most typically Swedish tradition of all: Midsummer.

    • 09:30 12:30
      Lectures: Deep learning Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
      Convener: Alexander Panin (Yandex School of Data Analysis (RU))
      • 09:30
        Deep learning I 1h 20m
        Speaker: Mr Alexander Panin (Yandex School of Data Analysis (RU))
      • 10:50
        Break 20m
      • 11:10
        Deep learning II 1h 20m
        Speaker: Mr Alexander Panin (Yandex School of Data Analysis (RU))
    • 12:30 13:30
      Organisational: Lunch Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
    • 13:30 16:30
      Seminars: Deep learning Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
      Convener: Alexander Panin (Yandex School of Data Analysis (RU))
      • 13:30
        Deep learning III 1h 20m
        Speaker: Mr Alexander Panin (Yandex School of Data Analysis (RU))
      • 14:50
        Break 20m
      • 15:10
        Deep learning IV 1h 20m
        Speaker: Mr Alexander Panin (Yandex School of Data Analysis (RU))
    • 16:30 16:50
      Organisational: Break Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
    • 16:50 17:50
      Invited lectures: Ultra High Energy Cosmic Rays and the CRAYFIS Experiment Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
      Convener: Chase Owen Shimmin (University of California Irvine (US))
    • 09:30 18:30
      Challenge hacking & conclusion Lundmarkssalen

      Lundmarkssalen

      Lund University

      Lund University, Lund, Sweden
      • 09:30
        Challenge hacking 1h 20m
        Time to apply all the knowledge and crack the challenge. Lecturers are available for questions. Feel free to grab coffee and lunch when it suits you.
      • 10:50
        Break 20m
      • 11:10
        Challenge hacking 3h 20m
      • 14:30
        Break 30m
      • 15:00
        Presentations preparation 1h
        Time to prepare the solution presentation.
      • 16:00
        Awards and best solutions presentations 1h 30m