Jul 9 – 13, 2018
Sofia, Bulgaria
Europe/Sofia timezone

The Future of Distributed Computing Systems in ATLAS: Boldly Venturing Beyond Grids

Jul 12, 2018, 2:30 PM
15m
Hall 7 (National Palace of Culture)

Hall 7

National Palace of Culture

presentation Track 3 – Distributed computing T3 - Distributed computing

Speaker

Fernando Harald Barreiro Megino (University of Texas at Arlington)

Description

The Production and Distributed Analysis system (PanDA) for the ATLAS experiment at the Large Hadron Collider has seen big changes over the past couple of years to accommodate new types of distributed computing resources: clouds, HPCs, volunteer computers and other external resources. While PanDA was originally designed for fairly homogeneous resources available through the Worldwide LHC Computing Grid, the new resources are heterogeneous, at diverse scales and with diverse interfaces. Up to a fifth of the resources available to ATLAS are of such new types and require special techniques for integration into PanDA. In this talk, we present the nature and scale of these resources. We provide an overview of the various challenges faced, spanning infrastructure, software distribution, workload requirements, scaling requirements, workflow management, data management, network provisioning, and associated software and computing facilities. We describe the strategies for integrating these heterogeneous resources into ATLAS, and the new software components being developed in PanDA to efficiently use them. Plans for software and computing evolution to meet the needs of LHC operations and upgrade in the long term future will be discussed.

Primary authors

Kaushik De (University of Texas at Arlington (US)) Alexei Klimentov (Brookhaven National Laboratory (US)) Doug Benjamin (Duke University (US)) Taylor Childers (Argonne National Laboratory (US)) Andrej Filipcic (Jozef Stefan Institute (SI)) Fernando Harald Barreiro Megino (University of Texas at Arlington) Tadashi Maeno (Brookhaven National Laboratory (US)) Danila Oleynik (Joint Institute for Nuclear Research (RU)) Sergey Panitkin (Brookhaven National Laboratory (US)) Torre Wenaus (Brookhaven National Laboratory (US))

Presentation materials