MLHEP 2015 summer school

Aug 27, 2015, 8:00 AM → Aug 30, 2015, 11:00 PM Europe/Moscow

Academic University

Summer school on Machine Learning in High Energy Physics http://www.hse.ru/mlhep2015/

Kaggle COMET competition

MLHEP github repo

Thu, August 27

8:00 AM → 8:15 AM Registration

8:15 AM → 9:00 AM breakfast

9:00 AM → 9:35 AM Welcome

Convener: Andrey Ustyuzhanin (Yandex School of Data Analysis (RU))

9:00 AM Welcome to MLHEP

2015-08_MLHEP_Welcome.pdf

9:20 AM MLHEP Kaggle competition

Speaker: Nikita Kazeev (Yandex School of Data Analysis (RU))

mlhep2015_kaggle_slides.pdf

9:35 AM → 9:40 AM break

9:40 AM → 12:40 PM Advanced track: lectures

Convener: Dr Victor Kitov (MSU)

9:40 AM Reminder about major algorithms. Advanced aspects of their use. Model evaluation.

Introduction. Model evaluation.pdf

11:00 AM coffee break

11:20 AM Feature selection. Regularization.

Feature selection.pdf

9:40 AM → 12:40 PM Introductory track: lectures

Convener: Alexey Rogozhnikov

9:40 AM Intro: General pipeline, ML at a glance

lecture1.pdf

11:00 AM coffee break

11:20 AM Intro: kNN, basic overfitting, roc curve, logistic regression

12:40 PM → 1:45 PM lunch

1:45 PM → 5:10 PM Advanced track: seminars

Convener: Tatiana Likhomanenko (National Research Centre Kurchatov Institute (RU))

1:45 PM MLHEP introduction. ML vs MLHEP: correlation and agreement restrictions

Speaker: Tatiana Likhomanenko (National Research Centre Kurchatov Institute (RU))

seminar1_part1.pdf

3:15 PM coffee break

3:40 PM sPlot technique. ML on sPlot data.

seminar1_part2.pdf

1:45 PM → 5:10 PM Introductory track: seminars

Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))

1:45 PM Introduction, course technicalities

1.1 Technicalities and principles.ipynb

1.2 Tools numpy pandas matplotlib - seminar.ipynb

3:15 PM coffee break

3:40 PM NumPy, Pandas, Matplotlib

5:10 PM → 5:20 PM break

5:20 PM → 7:00 PM Applying Machine Learning to LHC triggers optimization

Speaker: Mika Anton Vesterinen (Ruprecht-Karls-Universitaet Heidelberg (DE))

Mika_MLHEP.pdf

7:00 PM → 8:30 PM Welcome dinner

Fri, August 28

8:15 AM → 9:30 AM breakfast

9:30 AM → 12:30 PM Advanced track: lectures #2

Convener: Dr Victor Kitov (MSU)

9:30 AM model ensembling #1

10:50 AM coffee break

11:10 AM model ensembling #2

9:30 AM → 12:30 PM Introductory track: lectures #2

Convener: Alexey Rogozhnikov

9:30 AM neural networks

lecture2.pdf

10:50 AM coffee break

11:10 AM decision tree, regression tree

12:30 PM → 1:45 PM lunch

1:45 PM → 5:10 PM Advanced track: seminars #2

Convener: Tatiana Likhomanenko (National Research Centre Kurchatov Institute (RU))

1:45 PM Brave new boosting world: flatness boosting

seminar2.pdf

3:15 PM coffee break

3:40 PM Brave new boosting world: reweighing boosting. Iterative learning

1:45 PM → 5:10 PM Introductory track: seminars #2

Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))

1:45 PM Overfitting, Cross-validation

2.1. Basic ML, validation, feature engineering.ipynb

3:15 PM coffee break

3:40 PM Sklearn: KNN, decision tree, logistic regression

5:10 PM → 5:30 PM break

5:30 PM → 7:10 PM Challenges of searching for physics signatures with a large amount of background

Speaker: Patrick Haworth Owen (Imperial College Sci., Tech. & Med. (GB))

Patrick_Machine_Learning_in_LHCb.pdf

Sat, August 29

8:15 AM → 9:30 AM breakfast

9:30 AM → 12:30 PM Advanced track: lectures #3

Convener: Dr Victor Kitov (MSU)

9:30 AM Linear dimensionality reduction.

Dimensionality reduction.pdf

10:50 AM coffee break

11:10 AM Non-linear dimensionality reduction. Kernel trick. Common kernels.

9:30 AM → 12:30 PM Introductory track: lectures #3

Convener: Alexey Rogozhnikov

9:30 AM Ensembles

lecture3.pdf

10:50 AM coffee break

11:10 AM Gradient boosting; boosting to uniformity.

12:30 PM → 1:45 PM lunch

1:45 PM → 5:10 PM Advanced track: seminars #3

Convener: Tatiana Likhomanenko (National Research Centre Kurchatov Institute (RU))

1:45 PM Meta Algorithms Applications in HEP.

seminar3_part1.pdf

3:15 PM coffee break

3:40 PM Hypotheses testing.

seminar3_part2.pdf

1:45 PM → 5:10 PM Introductory track: seminars #3

Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))

1:45 PM Ensemble algorithms: random forest, gradient boosting

3.1 Ensemble methods - seminar.ipynb

COMET_gradient_boosting_gauss_opt.csv

3:15 PM coffee break

3:40 PM Hyperparam Optimization

3.2 Hyperparameters optimzation - seminar.ipynb

5:10 PM → 5:30 PM break

5:30 PM → 7:10 PM MVA vs cut-and-count techniques in the SM model processes searches and measurements

Speaker: Lesya Shchutska (University of Florida (US))

SUSY_mva.pdf

Sun, August 30

8:15 AM → 9:00 AM breakfast

9:00 AM → 12:00 PM Advanced track: lectures #4

Convener: Dr Victor Kitov (MSU)

9:00 AM Kernelized algorithms: SVM, regression, K-NN, PCA and their properties.

Kernel trick. Deep learning.pdf

10:20 AM coffee break

10:40 AM Deep learning. Different kinds of learning.

Kernel trick. Deep learning.pdf

Learning Deep Architectures for AI - Bengio.pdf

9:00 AM → 12:00 PM Introductory track: lectures #4

Convener: Alexey Rogozhnikov

9:00 AM GBDT tuning, reweighting, testing hypotheses, gaussian processes for optimization

lecture4.pdf

10:20 AM coffee break

10:40 AM Unsupervised learning, Latent Dirichlet Allocation, PCA. Fast predictions and pruning

12:00 PM → 1:00 PM lunch

1:00 PM → 4:15 PM Advanced track: seminars #4

Convener: Tatiana Likhomanenko (National Research Centre Kurchatov Institute (RU))

1:00 PM Summary: HEP ML analysis sketch, from data to discovery.

seminar4_summary.pdf

2:30 PM coffee break

2:45 PM My own first NN using theano.

1:00 PM → 4:15 PM Introductory track: seminars #4

Convener: Nikita Kazeev (Yandex School of Data Analysis (RU))

1:00 PM PCA, RBM and alike on MNIST

4.1 Generative models - seminar.ipynb

2:30 PM coffee break

2:45 PM Clustering

4.2. Clustering - seminar.ipynb

4:15 PM → 4:20 PM break

4:20 PM → 6:00 PM Multivariate techniques in the Higgs search

Speaker: Josh Bendavid (CERN)

mlhep-Aug30-2015.pdf

6:00 PM → 7:00 PM transfer to the boat

7:00 PM → 10:00 PM channel cruise + closing dinner + awards

10:00 PM → 11:00 PM transfer to the hotel