19–25 Oct 2024
Europe/Zurich timezone

High-throughput data distribution for CBM online computing

21 Oct 2024, 16:15
18m
Room 1.C (Small Hall)

Room 1.C (Small Hall)

Talk Track 2 - Online and real-time computing Parallel (Track 2)

Speaker

Jan de Cuveland (Goethe University Frankfurt (DE))

Description

The CBM experiment, currently being constructed at GSI/FAIR, aims to investigate QCD at high baryon densities. The CBM First-level Event Selector (FLES) serves as the central event selection system of the experiment. It functions as a high-performance computer cluster tasked with the online analysis of physics data, including full event reconstruction, at an incoming data rate which exceeds 1 TByte/s.

The CBM detector systems operate in a free-running and self-triggered manner, delivering time-stamped data streams. Without inherent event separation, timeslice building replaces global event building. The FLES HPC system integrates data from around 5000 input links into self-contained, overlapping processing intervals and distributes these to the compute nodes.

Using a combination of RDMA and zero-copy techniques, timeslices can be built efficiently over a high-throughput InfiniBand network and distributed to available online computing resources for a full online event reconstruction and analysis in a heterogeneous HPC cluster system. A new IPC online interface to timeslice data utilizes a Posix shared memory governed by a reference-counting item distributor. This design combines maximum performance and flexibility with minimum memory consumption. These new developments have already been successfully field-tested in production at the CBM predecessor experiment mCBM at the GSI/FAIR SIS18.

This work is supported by BMBF (05P21RFFC1).

Primary author

Jan de Cuveland (Goethe University Frankfurt (DE))

Co-authors

Dirk Hutter (Goethe University Frankfurt (DE)) Volker Lindenstruth (Goethe University Frankfurt (DE))

Presentation materials