Speaker
Dr
Douglas Smith
(STANFORD LINEAR ACCELERATOR CENTER)
Description
The Babar experiment produced one of the largest datasets in high
energy physics. To provide for many different concurrent analyses
the data is skimmed into many data streams before analysis can begin,
multiplying the size of the dataset both in terms of bytes and number
of files. As a large scale problem of job management and data
control, the Babar Task Manager system was developed. The system
proved not able to scale to the size of the problem, and it was
wished to distribute the production to many sites and use grid
resources to help. A development effort was started, and the Task
Manager II was the result. This has now been in production for over
a year in Babar, and produced several skim cycles of data, at multiple
computing centers, and was able to use grid resources. The structure
of the system will be presented, along with details on scalability to
number of jobs, and use of remote sites both with and without grid
resources.
Summary
Development of Babar data processing system and description.
| Presentation type (oral | poster) | oral |
|---|
Author
Dr
Douglas Smith
(STANFORD LINEAR ACCELERATOR CENTER)
Co-authors
Dr
Andreas Petzold
(Technische Universitat Dortmund)
Dr
Bertand Echenard
(California Institute of Technology)
Dr
Chris Brew
(Rutherford Appleton Laboratory)
Dr
Gregory DUBOIS-FELSMANN
(California Institute of Technology)
Dr
Tim ADYE
(Rutherford Appleton Laboratory)
Dr
Wilhelm J. ROETHEL
(University of California, Irvine)
