21-25 August 2017
University of Washington, Seattle
US/Pacific timezone

Global heterogeneous resource harvesting: the next-generation PanDA pilot for ATLAS

22 Aug 2017, 16:00
The Commons (Alder Hall)

The Commons

Alder Hall

Poster Track 1: Computing Technology for Physics Research Poster Session


Dr Ruslan Mashinistov (Russian Academy of Sciences (RU))


The Production and Distributed Analysis system (PanDA), used for workload management in the ATLAS Experiment for over a decade, has in recent years expanded its reach to diverse new resource types such as HPCs, and innovative new workflows such as the event service. PanDA meets the heterogeneous resources it harvests in the PanDA pilot, which has embarked on a next-generation reengineering to efficiently integrate and exploit the new platforms and workflows. The new modular architecture is the product of a year of design and prototyping in conjunction with the design of a completely new component, Harvester, that will mediate a richer flow of control and information between pilot and PanDA. Harvester will enable more intelligent and dynamic matching between processing tasks and resources, with an initial focus on HPCs, simplifying the operator and user view of a PanDA site but internally leveraging deep information gathering on the resource to accrue detailed knowledge of a site's capabilities and dynamic state to inform the matchmaking. This talk will give an overview of the new pilot architecture, how it will be used in and beyond ATLAS, its relation to Harvester, and the work ahead.

Primary authors

Mr Daniil Drizhuk (National Research Centre Kurchatov Institute (RU)) Paul Nilsson (Brookhaven National Laboratory (US)) Mario Lassnig (CERN) Wen Guan (University of Wisconsin (US)) Danila Oleynik (Joint Institute for Nuclear Research (RU)) Alexey Anisenkov (Budker Institute of Nuclear Physics (RU)) Pavlo Svirin (National Academy of Sciences of Ukraine (UA))

Presentation materials

Peer reviewing