22–26 Sept 2008
Harbiye Askeri Museum
Europe/Zurich timezone

Ganga and Diane: powerful job management and resource

23 Sept 2008, 16:06
Harbiye Askeri Museum

Harbiye Askeri Museum

Istanbul
Demo Demo Demos and Posters

Speakers

Adrian Muraru (Polytechnic Institute of Bucharest)Dr Andrew Maier (CERN IT/GS)Mr Anton Lechner (CERN IT/GS)Dr Hurng-Chun LEE (Academia Sinica)Dr Jakub Moscicki (CERN IT/GS)Dr Massimo Lamanna (CERN IT/GS)Dr Patricia Mendez Lorenzo (CERN IT/GS)

Describe the activity, tool or service using or enhancing the EGEE infrastructure or results. A high-level description is needed here (Neither a detailed specialist report nor a list of references is required).

Ganga is a lightweight job management tool developed at CERN, key component in the distributed Data Analysis for HEP. It interfaces to a variety of Grid and non-Grid backends using the same UI. DIANE provides a parallelization framework for applications and an optimizer of computing resources. It was developed at CERN to help VO using the distributed computing infrastructures more efficiently. The combination of both tools helps many Grid communities to use the Grid in an efficient way

Describe the added value of the grid for your activity, or the value your tool or service adds for other grid users. This should include the scale of the activity and of the potential user community, and the relevance for other scientific or business applications.

Ganga has gained widespread use in HEP applications and beyond. All these communities have different requirements and the main challenge is the creation of a standard software infrastructure for the immersion of these communities onto the Grid. This general infrastructure is effectively "shielding" the applications from the details of the Grid. It is flexible and general enough to match the requirements of the different productions without including major changes in the design of the tool. Ganga supports a large number of backends. DIANE was used in a number of computing activities, such as Avian Flu, Geant4 testing, medical simulations, computing support for ITU etc. In Avian Flu Data Challange the utilization of computing resources controlled by DIANE was 3-5 times more efficient than with direct job submission with less human supervision. In the ITU exercise around 200k short jobs (with convergence speed ranging between 1-1000sec) were executed in about 1 hour.

Report on the impact of the activity, tool or service. This should include a description of how grid technology enabled or enhanced the result, or how you have enabled or enhanced the infrastructure for other users.

From January 2007 to mid-2008 Ganga has been used by around 1500 users and has been installed locally in more than 50 sites around the world. Recently also the educative aspect of Ganga has been recognized and Ganga has become a part of the official EGEE tools. Contrary to other portals or tools, Ganga is not limited to specific VOs or infrastructures allowing new users to quickly exploit the EGEE infrastructure. It also allows for the interoperability of various Grid backends. DIANE plays an important role in the gridification of applications: very often there is a large gap between traditional application environment and, rather peculiar, Grid environment. DIANE is customizable by design and therefore offers great flexibility in adapting various application scenarios into the Grid model.

Abstracts for online demonstrations must provide a summary of the demo content. Places for demos are limited and this summary will be used as part of the selection procedure. Please include the visual impact of the demo and highlight any specific requirements (e.g. network connection). In general, a successful demo is expected to have some supporting material (poster) and be capable of running on a single screen or projector.

We will show how an application is gridified and how a user can immediately profit from the Grid using Ganga and Diane . We demonstrate application cases outside of the initial scope of High energy Physics in which the tool has been developed. The demo will show the ease of this transition from the traditional submission, running on single machines or a local batch cluster to running on the full EGEE infrastructure, using a concrete example from Lattice QCD

Primary authors

Adrian Muraru (Polytechnic Institute of Bucharest) Dr Andrew Maier (CERN IT/GS) Mr Anton Lechner (CERN IT/GS) Dr Hurng-Chun LEE (Academia Sinica) Dr Jakub Moscicki (CERN IT/GS) Dr Massimo Lamanna (CERN IT/GS) Dr Patricia Mendez Lorenzo (CERN IT/GS)

Presentation materials

There are no materials yet.