Second HSE-Yandex autumn school on generative models
from
Tuesday 24 November 2020 (09:45)
to
Friday 27 November 2020 (21:00)
Monday 23 November 2020
Tuesday 24 November 2020
09:45
Welcome
Welcome
09:45 - 10:00
Room: R602
10:00
Introduction to machine learning
Introduction to machine learning
10:00 - 11:00
Room: R602
11:00
Coffee Break
Coffee Break
11:00 - 11:30
Room: S812
11:30
Introduction to machine learning. Practice
Introduction to machine learning. Practice
11:30 - 12:30
Room: R602
12:30
Lunch
Lunch
12:30 - 14:00
14:00
Introduction to neural networks
Introduction to neural networks
14:00 - 15:00
Room: R602
15:00
Tea Break
Tea Break
15:00 - 15:30
Room: S812
15:30
Introduction to neural networks. Practice
Introduction to neural networks. Practice
15:30 - 16:30
Room: R602
16:30
Unusual Effects in Modern Deep Neural Networks
-
Dmitriy Vetrov
(
HSE
)
Unusual Effects in Modern Deep Neural Networks
Dmitriy Vetrov
(
HSE
)
16:30 - 17:30
Room: R602
Wednesday 25 November 2020
10:00
Introduction, the metrics for the generative models
Introduction, the metrics for the generative models
10:00 - 11:00
Room: R608
11:00
Coffee Break
Coffee Break
11:00 - 11:30
Room: S812
11:30
Generative adversarial networks
-
Artem Maevskiy
(
HSE University
)
Generative adversarial networks
Artem Maevskiy
(
HSE University
)
11:30 - 12:30
Room: R608
12:30
Group Photo
Group Photo
12:30 - 12:40
Room: R602
12:40
Lunch
Lunch
12:40 - 14:00
14:00
Generative Adversarial Networks. Practice
Generative Adversarial Networks. Practice
14:00 - 15:00
Room: R608
Contributions
14:00
Generative adversarial networks
-
Artem Maevskiy
(
HSE University
)
15:00
Tea Break
Tea Break
15:00 - 15:30
Room: S812
15:30
Introduction to the normalizing flows. Lecture
Introduction to the normalizing flows. Lecture
15:30 - 16:30
Room: R608
16:30
Tea Break
Tea Break
16:30 - 16:45
Room: R602
16:45
Normalizing flows, practice
Normalizing flows, practice
16:45 - 17:45
Room: R608
Thursday 26 November 2020
10:00
An introduction to bandit problems
An introduction to bandit problems
10:00 - 11:00
Room: R602
11:00
Coffee Break
Coffee Break
11:00 - 11:30
Room: S812
11:30
An introduction to bandit problems
An introduction to bandit problems
11:30 - 12:30
Room: R602
12:30
Lunch
Lunch
12:30 - 14:00
14:00
An introduction to bandit problems
An introduction to bandit problems
14:00 - 15:00
Room: R602
15:00
Tea Break
Tea Break
15:00 - 15:30
Room: S812
15:30
An introduction to bandit problems
An introduction to bandit problems
15:30 - 16:30
Room: R602
16:30
Robust mean estimation
-
Nikita Zhivotovskiy
(
Google, Higher School of Economics
)
Robust mean estimation
Nikita Zhivotovskiy
(
Google, Higher School of Economics
)
16:30 - 17:30
Room: R602
Friday 27 November 2020
10:00
Synthetic data and generative models in road sign recognition and other computer vision problems
-
Anton Konushin
(
Higher School of Economics
)
Synthetic data and generative models in road sign recognition and other computer vision problems
Anton Konushin
(
Higher School of Economics
)
10:00 - 10:40
Room: R602
10:40
Latent-Space Laplacian Pyramids for Adversarial Representation Learning with 3D Point Clouds
-
Alexey Artemov
(
Yandex
)
Latent-Space Laplacian Pyramids for Adversarial Representation Learning with 3D Point Clouds
Alexey Artemov
(
Yandex
)
10:40 - 11:20
Room: R602
Constructing high-quality generative models for 3D shapes is a fundamental task in computer vision with diverse applications in geometry processing, engineering, and design. Despite the recent progress in deep generative modelling, synthesis of finely detailed 3D surfaces, such as high-resolution point clouds, from scratch has not been achieved with existing approaches. In this work, we propose to employ the latent-space Laplacian pyramid representation within a hierarchical generative model for 3D point clouds. We combine the recently proposed latent-space GAN and Laplacian GAN architectures to form a multi-scale model capable of generating 3D point clouds at increasing levels of detail. Our evaluation demonstrates that our model outperforms the existing generative models for 3D point clouds.
11:20
Coffee Break
Coffee Break
11:20 - 11:40
Room: S813
11:40
Deep Generative Models for Knowledge Transfer
-
Evgeny Burnaev
(
Skoltech
)
Deep Generative Models for Knowledge Transfer
Evgeny Burnaev
(
Skoltech
)
11:40 - 12:20
Room: R602
12:20
Optimal transport and its application in bioinformatics
-
Alexandra Suvorikova
(
Higher School of Economics
)
Optimal transport and its application in bioinformatics
Alexandra Suvorikova
(
Higher School of Economics
)
12:20 - 13:00
Room: R602
13:00
Lunch
Lunch
13:00 - 14:10
14:10
How to reveal hidden geometric structures in data
-
Evgeny Stepanov
(
Higher School of Economics
)
How to reveal hidden geometric structures in data
Evgeny Stepanov
(
Higher School of Economics
)
14:10 - 14:50
Room: R602
14:50
Variational Inference: Mean Field, Normalizing Flows and beyond
-
Maxim Panov
(
Skoltech, HSE
)
Variational Inference: Mean Field, Normalizing Flows and beyond
Maxim Panov
(
Skoltech, HSE
)
14:50 - 15:30
Room: R602
In this talk we are going to discuss Variational approach to Bayesian Inference. We will start by reviewing standard mean-field approximations to the posterior as well as more powerful methods such as normalizing flows. Then we will discuss a new computationally efficient method to combine Variational Inference (VI) with Markov Chain Monte Carlo (MCMC). This approach can be used with generic MCMC kernels, but is especially well suited to MetFlow, a novel family of MCMC algorithms we introduce, in which proposals are obtained using Normalizing Flows. The marginal distribution produced by such MCMC algorithms is a mixture of flow-based distributions, thus drastically increasing the expressivity of the variational family. Unlike previous methods following this direction, our approach is amenable to the reparametrization trick and does not rely on computationally expensive reverse kernels
15:30
Big GANs Are Watching You: Towards Unsupervised Object Segmentation with Off-the-Shelf Generative Models
-
Stanislav Morozov
(
Yandex
)
Big GANs Are Watching You: Towards Unsupervised Object Segmentation with Off-the-Shelf Generative Models
Stanislav Morozov
(
Yandex
)
15:30 - 16:10
Room: R602
Since collecting pixel-level groundtruth data is expensive, unsupervised visual understanding problems are currently an active research topic. In particular, several recent methods based on generative models have achieved promising results for object segmentation and saliency detection. However, since generative models are known to be unstable and sensitive to hyperparameters, the training of these methods can be challenging and time-consuming. In this work, we introduce an alternative, much simpler way to exploit generative models for unsupervised object segmentation. First, we explore the latent space of the BigBiGAN -- the state-of-the-art unsupervised GAN, which parameters are publicly available. We demonstrate that object saliency masks for GAN-produced images can be obtained automatically with BigBiGAN. These masks then are used to train a discriminative segmentation model. Being very simple and easy-to-reproduce, our approach provides competitive performance on common benchmarks in the unsupervised scenario.
16:10
Tea Break
Tea Break
16:10 - 16:30
Room: R602
16:30
16:30 - 17:50
Room: R602
Contributions
16:30
How to reveal hidden geometric structures in data
-
Evgeny Stepanov
(
Higher School of Economics
)
17:50
The end
The end
17:50 - 18:00
Room: R602
19:00
Evening session -- Cancelled
Evening session -- Cancelled
19:00 - 20:30
Room: R602