Normalizing Flows for Probabilistic Modeling and Inference (Sections 1 and 2) <https://arxiv.org/abs/1912.02762> Authors: George Papamakarios, Eric Nalisnick, Danilo Jimenez Rezende, Shakir Mohamed, Balaji Lakshminarayanan Abstract: >Normalizing flows provide a general mechanism for defining expressive probability distributions, only requiring the specification of a (usually simple) base distribution and a series of bijective transformations. There has been much recent work on normalizing flows, ranging from improving their expressive power to expanding their application. We believe the field has now matured and is in need of a unified perspective. In this review, we attempt to provide such a perspective by describing flows through the lens of probabilistic modeling and inference. We place special emphasis on the fundamental principles of flow design, and discuss foundational topics such as expressive power and computational trade-offs. We also broaden the conceptual framing of flows by relating them to more general probability transformations. Lastly, we summarize the use of flows for tasks such as generative modeling, approximate inference, and supervised learning. Sections 1 and 2 only

Discussion on next topic Potential topics already mentioned: - [AlgebraNets](https://arxiv.org/abs/2006.07360) - [Denoising Diffusion Probabilistic Models](https://arxiv.org/abs/2006.11239) - [Object condensation: one-stage grid-free multi-object reconstruction in physics detectors, graph and image data](https://arxiv.org/abs/2002.03605) - [Topology-Preserving Deep Image Segmentation](https://arxiv.org/abs/1906.05404) - [More of the reinforcement learning textbook](http://www.incompleteideas.net/book/the-book-2nd.html) - [Old backprop paper](http://www.cs.toronto.edu/~hinton/absps/naturebp.pdf) - [FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence](https://arxiv.org/abs/2001.07685) - [A Simple Framework for Contrastive Learning of Visual Representations](https://arxiv.org/abs/2002.05709) - [Big Transfer (BiT): General Visual Representation Learning](https://arxiv.org/abs/1912.11370) - [Pay Attention to MLPs](https://arxiv.org/abs/2105.08050) - [Universal audio synthesizer control with normalizing flows](https://arxiv.org/abs/1907.00971) - [Neural Autoregressive Flows](https://arxiv.org/abs/1804.00779) - [Sharpness-Aware Minimization for Efficiently Improving Generalization](https://arxiv.org/abs/2010.01412)