5–9 May 2025
IJCLab, Paris
Europe/Paris timezone

Analysis at the HL-LHC: Data Delivery, ServiceX, and Addressing Our Analysis Challenges

6 May 2025, 17:05
40m
Auditorium P. Lehmann, Building 200 (IJCLab, Paris)

Auditorium P. Lehmann, Building 200

IJCLab, Paris

Domaine Universitaire Building 200 91400 Orsay
Talk Analysis at scale Plenary

Speaker

Gordon Watts (University of Washington (US))

Description

As the HL-LHC era approaches, the scale and complexity of data present challenges for analysis workflows within ATLAS and other HL-LHC experiments. This contribution reports on recent developments in ServiceX, a cross experiment utility, and its role as a data delivery and transformation service within the analysis ecosystem. Designed to bridge the gap between centrally produced datasets and user-level analysis code, ServiceX now supports a broader range of input formats—including custom non-ROOT ATLAS data—and has seen significant improvements in reliability, scalability, and ease of use.

We highlight progress in several areas: improved bullet-proofing of the data transformation infrastructure to avoid errors at scale; new convenience utilities for introspecting datasets (e.g., listing available branches); and tighter integration with common ATLAS frameworks such as TopCPTools, enabling more standardized analysis environments. We also share results from recent scaling tests demonstrating performance at analysis-scale workloads, and discuss how ServiceX fits into the broader analysis software stack, helping to address long-standing challenges of reproducibility, data access, and user efficiency.

This talk will provide a view of the design of ServiceX, the technical and usability gains made in recent months, and what’s coming next as we prepare for the HL-LHC's analysis demands.

Requested talk length 30

Authors

Artur Cordeiro Oudot Choi (University of Washington (US)) Benjamin Galewsky (Univ. Illinois at Urbana Champaign (US)) Gordon Watts (University of Washington (US)) Ilija Vukotic (University of Chicago (US)) Kyungeon Choi (University of Texas at Austin (US)) Peter Onyisi (University of Texas at Austin (US)) Roger Janusiak (University of Washington)

Presentation materials

There are no materials yet.