Nov 6 – 10, 2023
Europe/Zurich timezone

Learning the language of QCD jets with transformers

Nov 7, 2023, 2:00 PM
Seminarraum 4a/b (DESY)

Seminarraum 4a/b



Dr Alexander Mück (RWTH Aachen University)


Transformers have become the primary architecture for natural language processing. In this study, we explore their use for auto-regressive density estimation in high-energy jet physics. We draw an analogy between sentences and words in natural language and jets and their constituents. Specifically, we investigate density estimation for light QCD jets and hadronically decaying boosted top jets. We exploit the generative capability of our setup to assess the quality of the density estimate. Our results indicate that the generated data samples closely resemble the original data, in particular since they are difficult to distinguish from the original data even by a powerful supervised classifier.

Primary authors

Dr Alexander Mück (RWTH Aachen University) Michael Kramer (Rheinisch Westfaelische Tech. Hoch. (DE)) Thorben Finke

Presentation materials