21-27 March 2009
Prague
Europe/Prague timezone
- chep2009@particle.cz
Support
Babar Task Manager II
Presented by Dr. Douglas SMITH
on
23 Mar 2009
from
15:00
to
15:20
Content
The Babar experiment produced one of the largest datasets in high
energy physics. To provide for many different concurrent analyses
the data is skimmed into many data streams before analysis can begin,
multiplying the size of the dataset both in terms of bytes and number
of files. As a large scale problem of job management and data
control, the Babar Task Manager system was developed. The system
proved not able to scale to the size of the problem, and it was
wished to distribute the production to many sites and use grid
resources to help. A development effort was started, and the Task
Manager II was the result. This has now been in production for over
a year in Babar, and produced several skim cycles of data, at multiple
computing centers, and was able to use grid resources. The structure
of the system will be presented, along with details on scalability to
number of jobs, and use of remote sites both with and without grid
resources.
Summary
Development of Babar data processing system and description.
Presentation type
oral
Place
Location: Prague
Address: Prague Congress Centre
5. května 65, 140 00 Prague 4, Czech Republic
Room: Club C
Co-authors
- Dr. Tim ADYE Rutherford Appleton Laboratory
- Dr. Chris BREW Rutherford Appleton Laboratory
- Dr. Gregory DUBOIS-FELSMANN California Institute of Technology
- Dr. Bertand ECHENARD California Institute of Technology
Event calendar file