Multi-modal LLMs at EuXFEL: Knowledge Assistants, Data Exploration, and Policy- 15'+5'

11 Apr 2025, 09:30
20m
80/1-001 - Globe of Science and Innovation - 1st Floor (CERN)

80/1-001 - Globe of Science and Innovation - 1st Floor

CERN

Esplanade des Particules 1, 1211 Meyrin, Switzerland
60
Show room on map
Invited talks LLMs and AI Assistants LLMs and AI Assistants

Speaker

Florian Sohn (European XFEL GmbH)

Description

Multimodal Large Language models extend LLMs’ capabilities to input beyond text, often images. At the European XFEL, these models are used as Retrieval-Augmented Generative (RAG) Knowledge assistants in technical and administrative domains. We present a selection of current applications and prototypes: chatbot assistants for data service support, business travel aid, vision-based document exploration systems, coding assistants, and an application rating control system panels for accessibility and design. The aforementioned examples were studied as part of an effort to create a policy for the usage of LLMs by facility staff. We highlight how this policy is influenced by the aforementioned examples and associated legal and data privacy considerations.

Authors

Danilo Enoque Ferreira De Lima (European XFEL GmbH) Florian Sohn (European XFEL GmbH) Illia Derevianko (European XFEL GmbH) Dr Krzysztof Wrona (European XFEL GmbH) Lisa Brodersen (European XFEL GmbH) Dr Luca Gelisio (European XFEL GmbH) Mahmoud Adjami (European XFEL GmbH) Maurizio Manetti (European XFEL GmbH) Robert Rosca (European XFEL GmbH) Steffen Hauf

Presentation materials