Oct 10 – 14, 2016
San Francisco Marriott Marquis
America/Los_Angeles timezone

Online & Offline Storage and Processing for the upcoming European XFEL Experiments

Oct 11, 2016, 11:00 AM
GG C3 (San Francisco Mariott Marquis)


San Francisco Mariott Marquis

Oral Track 4: Data Handling Track 4: Data Handling


Martin Gasthuber (DESY)


For the upcoming experiments at the European XFEL light source facility, a new online and offline data processing and storage infrastructure is currently being built and verified. Based on the experience of the system being developed for the Petra III light source at DESY, presented at the last CHEP conference, we further develop the system to cope with the much higher volumes and rates (~50GB/sec) together with a more complex data analysis and infrastructure conditions (i.e. long range InfiniBand connections). This work will be carried out in collaboration of DESY/IT, European XFEL and technology support from IBM/Research.
This presentation will shortly wrap up the experience of ~1 year runtime of the PetraIII system, continue with a short description of the challenges for the European XFEL experiments and the main section, showing the proposed system for online and offline with initial result from real implementation (HW & SW). This will cover the selected cluster filesystem GPFS including Quality of Service (QOS), extensive use of Flash subsystems and other new and unique features this architecture will benefit from.

Primary Keyword (Mandatory) Storage systems
Tertiary Keyword (Optional) High performance computing
Secondary Keyword (Optional) Computing facilities

Primary authors


Birgit Lewendel (Deutsches Elektronen-Synchrotron (DE)) Mr Djelloul Boukhelef (XFEL) Mr Janusz Szuba (XFEL) Krzysztof Wrona (European XFEL) Mrs Manuela Kuhn (DESY) Mr Uwe Ensslin (DESY) Volker Guelzow (Deutsches Elektronen-Synchrotron (DE))

Presentation materials