Speakers
Dr
Tomasz Wlodek
(Brookhaven National Laboratory (BNL))Dr
Yuri Smirnov
(Brookhaven National Laboratory (BNL))
Description
The PanDA distributed production and analysis system has been in
production use for ATLAS data processing and analysis since late 2005
in the US, and globally throughout ATLAS since early 2008. Its core
architecture is based on a set of stateless web services served by
Apache and backed by a suite of MySQL databases that are the
repository for all Panda information: active and archival job queues,
dataset and file catalogs, site configuration information, monitoring
information, system control parameters, and so on. This database
system is one of the most critical components of PanDA, and has
successfully delivered the functional and scaling performance
required by PanDA, currently operating at a scale of half a million
jobs per week, with much growth still to come.
In this paper we describe the design and implementation of the PanDA
database system, its architecture of MySQL servers deployed at BNL
and CERN, backup strategy and monitoring tools. The system has been
developed, thoroughly tested, and brought to production to provide
highly reliable, scalable, flexible and available database services
for ATLAS Monte Carlo production, reconstruction and physics
analysis.
Primary authors
Dr
Tomasz Wlodek
(Brookhaven National Laboratory (BNL))
Dr
Yuri Smirnov
(Brookhaven National Laboratory (BNL))
Co-authors
Dr
Dantong Yu
(Brookhaven National Laboratory (BNL))
Dr
Jason Smith
(Brookhaven National Laboratory (BNL))
Mr
John Hover
(Brookhaven National Laboratory (BNL))
Prof.
Kaushik De
(University of Texas at Arlington)
Dr
Nurcan Ozturk
(University of Texas at Arlington)
Dr
Torre Wenaus
(Brookhaven National Laboratory (BNL))
