21-27 March 2009
Prague
Europe/Prague timezone

Experience with ATLAS MySQL Panda DataBase service

23 Mar 2009, 08:00
1h
Prague

Prague

Prague Congress Centre 5. května 65, 140 00 Prague 4, Czech Republic
Board: Monday 014
poster Software Components, Tools and Databases Poster session

Speakers

Dr Tomasz Wlodek (Brookhaven National Laboratory (BNL))Dr Yuri Smirnov (Brookhaven National Laboratory (BNL))

Description

The PanDA distributed production and analysis system has been in production use for ATLAS data processing and analysis since late 2005 in the US, and globally throughout ATLAS since early 2008. Its core architecture is based on a set of stateless web services served by Apache and backed by a suite of MySQL databases that are the repository for all Panda information: active and archival job queues, dataset and file catalogs, site configuration information, monitoring information, system control parameters, and so on. This database system is one of the most critical components of PanDA, and has successfully delivered the functional and scaling performance required by PanDA, currently operating at a scale of half a million jobs per week, with much growth still to come. In this paper we describe the design and implementation of the PanDA database system, its architecture of MySQL servers deployed at BNL and CERN, backup strategy and monitoring tools. The system has been developed, thoroughly tested, and brought to production to provide highly reliable, scalable, flexible and available database services for ATLAS Monte Carlo production, reconstruction and physics analysis.

Primary authors

Dr Tomasz Wlodek (Brookhaven National Laboratory (BNL)) Dr Yuri Smirnov (Brookhaven National Laboratory (BNL))

Co-authors

Dr Dantong Yu (Brookhaven National Laboratory (BNL)) Dr Jason Smith (Brookhaven National Laboratory (BNL)) Mr John Hover (Brookhaven National Laboratory (BNL)) Prof. Kaushik De (University of Texas at Arlington) Dr Nurcan Ozturk (University of Texas at Arlington) Dr Torre Wenaus (Brookhaven National Laboratory (BNL))

Presentation Materials

There are no materials yet.