Transformer Architectures

• Marcel Roed (CERN)

In this ML JC, we will learn about and discuss transformer architectures in general, with a focus on potential applications in HEP. Some good reading material for preparation: - http://peterbloem.nl/blog/transformers - https://arxiv.org/abs/1706.03762