ACAT 2025

New Transformation Capabilities and Workflow Integration for ServiceX, a Delivery System for Distributed Data

Not scheduled

30m

Hamburg, Germany

Poster Track 1: Computing Technology for Physics Research Poster session with coffee break

Speaker

Peter Onyisi (University of Texas at Austin (US))

Description

The ServiceX project aims to provide a data extraction and delivery service for HEP analysis data, accessing files from distributed stores and applying user-configured transformations on them. ServiceX aims to support many existing analysis workflows and tools in as transparent a manner as possible, while enabling new technologies. We will discuss the most recent backends added to ServiceX, including RDataFrame support and the ability to read and write RNTuples. We will also discuss usability improvements in the user client libraries, in particular the ability to store and propagate metadata to downstream tools.

Significance

ServiceX has significantly expanded the range of transformations it can run in order to accommodate many more real-world workflows, and the client integration with external tools (in particular metadata handling) is new.

References

https://indico.cern.ch/event/1330797/contributions/5796587/