21-25 May 2012
New York City, NY, USA
US/Eastern timezone

ATLAS Grid Data Processing: system evolution and scalability

22 May 2012, 13:30
4h 45m
Rosenthal Pavilion (10th floor) (Kimmel Center)

Rosenthal Pavilion (10th floor)

Kimmel Center

Poster Distributed Processing and Analysis on Grids and Clouds (track 3) Poster Session

Speaker

Pavel Nevski (Brookhaven National Laboratory (US))

Description

The production system for Grid Data Processing (GDP) handles petascale ATLAS data reprocessing and Monte Carlo activities. The production system empowered further data processing steps on the Grid performed by dozens of ATLAS physics groups with coordinated access to computing resources worldwide, including additional resources sponsored by regional facilities. The system provides knowledge management of configuration parameters for massive data processing tasks, reproducibility of results, scalable database access, orchestrated workflow and performance monitoring, dynamic workload sharing, automated fault tolerance and petascale data integrity control. The system evolves to accommodate a growing number of users and new requirements from our contacts in ATLAS main areas: Trigger, Physics, Data Preparation and Software & Computing. To assure scalability, the next generation production system architecture development is in progress. We report on scaling up the GDP production system for a growing number of users providing data for physics analysis and other ATLAS main activities.

Primary authors

Andrei Minaenko (Institute for High Energy Physics (RU)) Collaboration Atlas (Atlas)

Co-authors

Alexandre Vaniachine (ATLAS) Dr Alexei Klimentov (Brookhaven National Laboratory (US)) Borut Kersevan (Jozef Stefan Institute) Dmitri Golubkov (Institute for High Energy Physics (IHEP)-Unknown-Unknown) Pavel Nevski (Brookhaven National Laboratory (US)) Dr Rodney Walker (Ludwig-Maximilians-Univ. Muenchen (DE))

Presentation Materials