10-15 March 2019
Steinmatte conference center
Europe/Zurich timezone

The second generation of the ATLAS Production System: expertise and future evolution

13 Mar 2019, 16:30
20m
Steinmatte Plenary

Steinmatte Plenary

Oral Track 1: Computing Technology for Physics Research Track 1: Computing Technology for Physics Research

Speaker

Misha Borodin (University of Iowa (US))

Description

ATLAS production system called ProdSys2 is used during Run2 to define
and to organize workflows and to schedule, submit and execute payloads
in a distributed computing infrastructure. We design ProdSys2 to manage
all ATLAS workflows: data (re)processing, MC simulation, physics groups
analysis objects production, High Level Trigger processing, SW release
building and user analysis. It simplifies the life of ATLAS scientists by
offering a web-based user interface with rich options, which
implements a user-friendly environment for workflow management, such as
a simple way of combining different data flows, and real-time monitoring,
optimised for use with a huge amount of information to present. We
present an overview of the ATLAS Production System technical
implementation: job and task definitions, workflow manager and the web-based user
interface. We show how it interfaces to different computing resources, for
instance, HPC systems and clouds, and how the Production System interacts with
the ATLAS data management system. We describe important technical design
decisions, work experience acquired during the LHC Run2 and how will the Production System
evolve to be used in the heterogeneous computing environment foreseen for
Run3 and High-Luminosity LHC.

Primary authors

Misha Borodin (University of Iowa (US)) Alexei Klimentov (Brookhaven National Laboratory (US)) Dmitry Golubkov (Institute for High Energy Physics of NRC Kurchatov Institute (R) Mikhail Titov (National Research Centre Kurchatov Institute (RU)) Tadashi Maeno (Brookhaven National Laboratory (US)) Fernando Harald Barreiro Megino (University of Texas at Arlington)

Presentation materials