21-27 March 2009
Prague
Europe/Prague timezone
Home > Timetable > Session details > Contribution details
PDF | XML | iCal

Babar Task Manager II

Presented by Dr. Douglas SMITH on 23 Mar 2009 from 15:00 to 15:20
Type: oral
Track: Distributed Processing and Analysis

Content

The Babar experiment produced one of the largest datasets in high energy physics. To provide for many different concurrent analyses the data is skimmed into many data streams before analysis can begin, multiplying the size of the dataset both in terms of bytes and number of files. As a large scale problem of job management and data control, the Babar Task Manager system was developed. The system proved not able to scale to the size of the problem, and it was wished to distribute the production to many sites and use grid resources to help. A development effort was started, and the Task Manager II was the result. This has now been in production for over a year in Babar, and produced several skim cycles of data, at multiple computing centers, and was able to use grid resources. The structure of the system will be presented, along with details on scalability to number of jobs, and use of remote sites both with and without grid resources.

Summary

Development of Babar data processing system and description.

Presentation type

oral

Place

Location: Prague
Address: Prague Congress Centre 5. května 65, 140 00 Prague 4, Czech Republic
Room: Club C

Primary authors

More

Co-authors

More