21-27 March 2009
Prague
Europe/Prague timezone

Babar Task Manager II

23 Mar 2009, 15:00
20m
Club C (Prague)

Club C

Prague

Prague Congress Centre 5. května 65, 140 00 Prague 4, Czech Republic
oral Distributed Processing and Analysis Distributed Processing and Analysis

Speaker

Dr Douglas Smith (STANFORD LINEAR ACCELERATOR CENTER)

Description

The Babar experiment produced one of the largest datasets in high energy physics. To provide for many different concurrent analyses the data is skimmed into many data streams before analysis can begin, multiplying the size of the dataset both in terms of bytes and number of files. As a large scale problem of job management and data control, the Babar Task Manager system was developed. The system proved not able to scale to the size of the problem, and it was wished to distribute the production to many sites and use grid resources to help. A development effort was started, and the Task Manager II was the result. This has now been in production for over a year in Babar, and produced several skim cycles of data, at multiple computing centers, and was able to use grid resources. The structure of the system will be presented, along with details on scalability to number of jobs, and use of remote sites both with and without grid resources.

Summary

Development of Babar data processing system and description.

Presentation type (oral | poster) oral

Primary author

Dr Douglas Smith (STANFORD LINEAR ACCELERATOR CENTER)

Co-authors

Dr Andreas Petzold (Technische Universitat Dortmund) Dr Bertand Echenard (California Institute of Technology) Dr Chris Brew (Rutherford Appleton Laboratory) Dr Gregory DUBOIS-FELSMANN (California Institute of Technology) Dr Tim ADYE (Rutherford Appleton Laboratory) Dr Wilhelm J. ROETHEL (University of California, Irvine)

Presentation Materials