13–17 Feb 2006
Tata Institute of Fundamental Research
Europe/Zurich timezone

On Demand, Policy Based Monte Carlo Production and Tracking, Leveraging Clarens, MonALISA and RunJob

15 Feb 2006, 09:00
9h 10m
Tata Institute of Fundamental Research

Tata Institute of Fundamental Research

Homi Bhabha Road Mumbai 400005 India
poster Distributed Event production and processing Poster

Speaker

Dr Frank van Lingen (CALIFORNIA INSTITUTE OF TECHNOLOGY)

Description

Abstract: We describe a set of Web Services, created to support scientists in performing distributed production tasks (e.g. Monte Carlo). The Web Services described in this paper provide a portal for scientists to execute different production workflows which can consist of many consecutive steps. The main design goal of the Web Services discussed is to provide controlled access for (multiple) set(s) of users in different roles (e.g. scientists, administrators, grid operators,…) to complex production workflows without the added trouble of updating, configuring, and patching these ever evolving applications and keep the users focused on their core tasks (running production), while experts at the Tier2 centers keep the software up to date. Once users execute a workflow they recieve a tracking number that is used to track the job status which is propagated through MonALISA. Job anomalies can be further investigated using the JobMon service. The Web Services have been implemented inside the Clarens Web Service framework. This Python (and Java) based framework provides, amongst others, x509 authorization, access control and VO management for its services. The Web Services discussed in this paper re-use several of these Clarens components in providing access control and usage quotas. Initially the services described in this paper where developed to support users in Monte Carlo production activities, however due to their generic design, can be used to expose other (potentially complex) applications to users as will be shown in this paper.

Primary author

Dr Frank van Lingen (CALIFORNIA INSTITUTE OF TECHNOLOGY)

Co-authors

Mr Abishek Rana (University of San Diego) Dr Conrad Steenberg (CALIFORNIA INSTITUTE OF TECHNOLOGY) Dr Dave Evans (Fermilab) Dr Elliot Lipeless (Fermilab) Dr Frank Wuerthwein (University of San Diego) Prof. Harvey Newman (CALIFORNIA INSTITUTE OF TECHNOLOGY) Dr Iosif Legrand (CALIFORNIA INSTITUTE OF TECHNOLOGY) Dr Julian Bunn (CALIFORNIA INSTITUTE OF TECHNOLOGY) Mr Michael Thomas (CALIFORNIA INSTITUTE OF TECHNOLOGY) Mr Shih-Chieh Hsu (Fermilab) Mr Terrence Martin (University of San Diego)

Presentation materials