27 September 2004 to 1 October 2004
Interlaken, Switzerland
Europe/Zurich timezone

HEP Applications Experience with the European DataGrid Middleware and Testbed

27 Sept 2004, 16:30
20m
Ballsaal (Interlaken, Switzerland)

Ballsaal

Interlaken, Switzerland

oral presentation Track 5 - Distributed Computing Systems and Experiences Distributed Computing Systems and Experiences

Speaker

S. Burke (Rutherford Appleton Laboratory)

Description

The European DataGrid (EDG) project ran from 2001 to 2004, with the aim of producing middleware which could form the basis of a production Grid, and of running a testbed to demonstrate the middleware. HEP experiments (initially the four LHC experiments and subsequently BaBar and D0) were involved from the start in specifying requirements, and subsequently in evaluating the performance of the middleware, both with generic tests and through increasingly complex data challenges. A lot of experience has therefore been gained which may be valuable to future Grid projects, in particular LCG and EGEE which are using a substantial amount of the middleware developed in EDG. We report our experiences with job submission, data management and mass storage, information and monitoring systems, Virtual Organisation management and Grid operations, and compare them with some typical Use Cases defined in the context of LCG. We also describe some of the main lessons learnt from the project, in particular in relation to configuration, fault-tolerance, interoperability and scalability, as well as the software development process itself, and point out some areas where further work is needed. We also make some comments on how these issues are being addressed in LCG and EGEE.

Primary authors

A. De Salvo (INFN Rome 1) A. Fanfani (INFN Bologna) A. Tsaregorodtsev (Marseille) C. Grandi (INFN-Bologna) D. Boutigny (LAPP Annecy) D. Colling (Imperial) D. Groep (NIKHEF) E. Luppi (INFN Sezione di Ferrara) F. Brochu (Cambridge) F. Carminati (CERN) F. Harris (CERN/Oxford) G. Negri (INFN Milan) I. Augustin (CERN) I. Stokes-Rees (Oxford) J J. Blaising (LAPP Annecy) J. Closier (CERN) K. Bos (NIKHEF) L. Perini (INFN Milan) M. Reale (INFN Rome 1) O. Maroney (Bristol) O. Smirnova (Lund) P. Capiluppi (INFN Bologna) P. Cerello (INFN Turin) R. Barbera (INFN Catania) S. Bagnasco (INFN Turin) S. Burke (Rutherford Appleton Laboratory) S. Resconi (INFN Milan) V. GARONNE (CNRS-IN2P3-CPPM, MARSEILLE) W. van Leeuwen (NIKHEF)

Presentation materials