19–25 Oct 2024
Europe/Zurich timezone

Sprucing and Analysis Productions: Offline data processing in LHCb without the pain

21 Oct 2024, 15:00
18m
Room 1.B (Medium Hall B)

Room 1.B (Medium Hall B)

Talk Track 3 - Offline Computing Parallel (Track 3)

Speaker

Dr Nicole Skidmore (University of Warwick)

Description

After two successful physics runs the LHCb experiment underwent a comprehensive upgrade to enable LHCb to run at five times the instantaneous luminosity for Run 3 of the LHC. With this upgrade, LHCb is now the largest producer of data at the LHC. A new offline dataflow was developed to facilitate fast time-to-insight whilst respecting constraints from disk and CPU resources. The Sprucing is an offline data processing step that further refines the selections and persistency of physics channels coming out of the trigger system. In addition, the Sprucing splits the data into multiple streams, which are written in a format that facilitates more efficient compression. Next, Analysis Productions provide LHCb analysts with a declarative approach to tupling this data, efficiently exploiting WLCG resources in a centralised way.
The Sprucing and Analysis Productions offline chain provides analysts with their customised tuples within days of the data being taken by the LHCb experiment.
This talk will present the development of this offline data processing chain with a focus on performance results gathered during operations in 2024.

Primary authors

Chris Burr (CERN) Dr Nicole Skidmore (University of Warwick)

Presentation materials