Towards Real-World Applications of ServiceX, an Analysis Data Transformation System

19 May 2021, 11:03
13m
Short Talk Distributed Computing, Data Management and Facilities Facilities and Networks

Speaker

Kyungeon Choi (University of Texas at Austin (US))

Description

One of the biggest challenges in the High-Luminosity LHC (HL- LHC) era will be the significantly increased data size to be recorded and an- alyzed from the collisions at the ATLAS and CMS experiments. ServiceX is a software R&D project in the area of Data Organization, Management and Access of the IRIS- HEP to investigate new computational models for the HL- LHC era. ServiceX is an experiment-agnostic service to enable on-demand data delivery specifically tailored for nearly-interactive vectorized analyses. It is capable of retrieving data from grid sites, on-the-fly data transformation, and delivering user-selected data in a variety of different formats. New features will be presented that make the service ready for public use. An ongoing effort to integrate ServiceX with a popular statistical analysis framework in ATLAS will be described with an emphasis of a practical implementation of ServiceX into the physics analysis pipeline.

Primary authors

Kyungeon Choi (University of Texas at Austin (US)) Andrew Eckart (University of Chicago) Benjamin Galewsky (Univ. Illinois at Urbana Champaign (US)) Robert William Gardner Jr (University of Chicago (US)) Mark Neubauer (Univ. Illinois at Urbana Champaign (US)) Peter Onyisi (University of Texas at Austin (US)) Mason Proffitt (University of Washington (US)) Ilija Vukotic (University of Chicago (US)) Gordon Watts (University of Washington (US))

Presentation materials

Proceedings

Paper