14-18 October 2013
Amsterdam, Beurs van Berlage
Europe/Amsterdam timezone

Next Generation PanDA Pilot for ATLAS and Other Experiments

14 Oct 2013, 15:00
45m
Grote zaal (Amsterdam, Beurs van Berlage)

Grote zaal

Amsterdam, Beurs van Berlage

Poster presentation Distributed Processing and Data Handling A: Infrastructure, Sites, and Virtualization Poster presentations

Speaker

Paul Nilsson (University of Texas at Arlington (US))

Description

The Production and Distributed Analysis system (PanDA) has been in use in the ATLAS Experiment since 2005. It uses a sophisticated pilot system to execute submitted jobs on the worker nodes. While originally designed for ATLAS, the PanDA Pilot has recently been refactored to facilitate use outside of ATLAS. Experiments are now handled as plug-ins, and a new PanDA Pilot user only has to implement a set of prototyped methods in the plug-in classes, and provide a script that configures and runs the experiment specific payload. We will give an overview of the Next Generation PanDA Pilot system and will present major features and recent improvements including live user payload debugging, data access via the federated xrootd system, stage-out to alternative storage elements, support for the new ATLAS DDM system (Rucio), and an improved integration with glExec, as well as a description of the experiment specific plug-in classes. The performance of the pilot system in processing LHC data on the OSG, LCG and NorduGrid infrastructures used by ATLAS will also be presented. We will describe plans for future development on the time scale of the next few years.

Primary author

Paul Nilsson (University of Texas at Arlington (US))

Co-authors

Fernando Harald Barreiro Megino (CERN) John Hover (Brookhaven National Laboratory (BNL)-Unknown-Unknown) Dr Jose Caballero Bejar (Brookhaven National Laboratory (US)) Kaushik De (University of Texas at Arlington (US)) Peter Love (LANCASTER UNIVERSITY) Ramon Medrano Llamas (CERN) Dr Rodney Walker (Ludwig-Maximilians-Univ. Muenchen (DE)) Tadashi Maeno (Brookhaven National Laboratory (US)) Dr Torre Wenaus (Brookhaven National Laboratory (US))

Presentation Materials