21-27 March 2009
Prague
Europe/Prague timezone

A generic Job Submission Tool (JST).

24 Mar 2009, 16:30
20m
Club C (Prague)

Club C

Prague

Prague Congress Centre 5. května 65, 140 00 Prague 4, Czech Republic
oral Distributed Processing and Analysis Distributed Processing and Analysis

Speaker

Dr Giacinto Donvito (INFN-Bari)

Description

The Job Submitting Tool provides a solution for the submission of a large number of jobs to the grid in an unattended way. Indeed the tool is able to manage the grid submission, bookkeeping and resubmission of failed jobs . It also allows the monitor in real time of the status of each job using the same framework. The key elements of this tool are: A Relational Db that contains all the tasks to execute on the grid (the solution was found to be scalable up to few thousands of concurrent running jobs). It is possible to launch on the grid tasks handled by different software. JST is also capable to handle the dependence between tasks. If task B depends on the execution of task A, then JST will launch task B only after the correct execution of task A. a submission agent that submits jobs on behalf of the user if the database contain tasks to be executed. A job wrapper that is executed on the WN. It takes care of interacting with the task queue server and manages the execution of the real application on the WN, in particular check is the application execution was completed without errors. A web interface that allow the use to submit new run or new application using JST. The tool has been extensively tested to submit bioinformatics application to the grid, but it is general enough to be used in other fields including particle physics data analysis

Summary

A generic Tool for job submission, monitoring and bookkeping over the grid.

Presentation type (oral | poster) oral

Primary author

Dr Giacinto Donvito (INFN-Bari)

Co-authors

Prof. Giorgio Pietro Maggi (INFN-Bari and Politecnico di Bari) Dr Guido Cuscela (INFN-Bari)

Presentation Materials