27 September 2004 to 1 October 2004
Interlaken, Switzerland
Europe/Zurich timezone

Federating Grids: LCG meets Canadian HEPGrid

29 Sep 2004, 10:00
1h
Coffee (Interlaken, Switzerland)

Coffee

Interlaken, Switzerland

Board: 67
poster Track 5 - Distributed Computing Systems and Experiences Poster Session 2

Speaker

R. Walker (Simon Fraser University)

Description

A large number of Grids have been developed, motivated by geo-political or application requirements. Despite being mostly based on the same underlying middleware, the Globus Toolkit, they are generally not inter-operable for a variety of reasons. We present a method of federating those disparate grids which are based on the Globus Toolkit, together with a concrete example of interfacing the LHC grid(LCG) with HEPGrid. HEPGrid consists of shared resources, at several Canadian research institutes, which are exposed via Globus gatekeepers, and makes use of Condor-G for resource advertisement, matchmaking and job submission. An LCG Computing Element(CE) based at the TRIUMF Laboratory hosts a HEPGrid User Interface(UI) which is contained within a custom jobmanager. This jobmanager appears in the LCG information system as a normal CE publishing an aggregation of the HEPGrid resources. The interface interprets the incoming job in terms of HEPGrid UI usage, submits it onto HEPGrid, and implements the jobmanager 'poll' and 'remove' methods, thus enabling monitoring and control across the grids. In this way non-LCG resources are integrated into LCG, without the need for LCG middleware on those resources. The same method can be used to create interfaces between other grids, with the details of the child-Grid being fully abstracted into the interface layer. The LCG-HEPGrid interface is operational, and has been used to federate 1300 CPU's at 4 sites into LCG for the Atlas Data Challenge (DC2).

Primary authors

A. Agarwal (University of Victoria) A. Dimopoulos (University of Victoria) B. Caron (University of Alberta/TRIUMF) C. Lindsay (University of Victoria) D. Vanderster (University of Victoria) G. Mateescu (Ottawa) L. Klektau (University of Victoria) M. Vetterli (Simon Fraser University/TRIUMF) R. Impey (Ottawa) R. Sobie (University of Victoria) R. Walker (Simon Fraser University)

Presentation Materials