Babar Task Manager II
Presented by Dr. Douglas SMITH on 23 Mar 2009 from 15:00 to 15:20
Session: Distributed Processing and Analysis
Track: Distributed Processing and Analysis
The Babar experiment produced one of the largest datasets in high energy physics. To provide for many different concurrent analyses the data is skimmed into many data streams before analysis can begin, multiplying the size of the dataset both in terms of bytes and number of files. As a large scale problem of job management and data control, the Babar Task Manager system was developed. The system proved not able to scale to the size of the problem, and it was wished to distribute the production to many sites and use grid resources to help. A development effort was started, and the Task Manager II was the result. This has now been in production for over a year in Babar, and produced several skim cycles of data, at multiple computing centers, and was able to use grid resources. The structure of the system will be presented, along with details on scalability to number of jobs, and use of remote sites both with and without grid resources.
Development of Babar data processing system and description.
Address: Prague Congress Centre 5. května 65, 140 00 Prague 4, Czech Republic
Room: Club C
- Dr. Tim ADYE Rutherford Appleton Laboratory
- Dr. Chris BREW Rutherford Appleton Laboratory
- Dr. Gregory DUBOIS-FELSMANN California Institute of Technology
- Dr. Bertand ECHENARD California Institute of Technology