M. Rød: Transformers

Thursday 2 Sept 2021, 10:30 → 11:30 Europe/Zurich

10:30 → 11:30 Transformer Architectures

In this ML JC, we will learn about and discuss transformer architectures in general, with a focus on potential applications in HEP.

Some good reading material for preparation:
- http://peterbloem.nl/blog/transformers
- https://arxiv.org/abs/1706.03762

Speaker: Marcel Roed (CERN)

Transformers.key

Transformers.pdf