27 September 2004 to 1 October 2004
Interlaken, Switzerland
Europe/Zurich timezone

Cross Experiment Workflow Management: The Runjob Project

29 Sept 2004, 10:00
1h
Coffee (Interlaken, Switzerland)

Coffee

Interlaken, Switzerland

Board: 36
poster Track 4 - Distributed Computing Services Poster Session 2

Speaker

P. Love (Lancaster University)

Description

Building on several years of sucess with the MCRunjob projects at DZero and CMS, the fermilab sponsored joint Runjob project aims to provide a Workflow description language common to three experiments: DZero, CMS and CDF. This project will encapsulate the remote processing experiences of the three experiments in an extensible software architecture using web services as a communication medium. The core of the Runjob project will be the Shahkar software packages that provide services for describing jobs and targeting them at different execution environments. A common interface to multiple storage and compute grid elements will be provided, alllowing the three experiments to share hardware resources in a transparent manner. Several tools provided by Shahkar are discussed including FileMetaBrokers, hich provide a uniform way to handle files and metadata over a distributed cluster, the ShREEK runtime execution environment that allows executable jobs to provide a real time monitoring and control interface to any system, the scriptObject generic task encapsulation objects and XMLProcessor object persistency tool.

Primary authors

D. Evans (Computing Division, Fermi National Accelerator Laboratory) G. Graham (Computing Division, Fermi National Accelerator Laboratory) I. Bertram (Lancaster University) P. Love (Lancaster University)

Presentation materials