21-25 May 2012
New York City, NY, USA
US/Eastern timezone

The Integration of CloudStack and OpenNebula with DIRAC

22 May 2012, 13:55
25m
Eisner & Lubin Auditorium (Kimmel Center)

Eisner & Lubin Auditorium

Kimmel Center

Parallel Distributed Processing and Analysis on Grids and Clouds (track 3) Distributed Processing and Analysis on Grids and Clouds

Speakers

Victor Manuel Fernandez Albor (Universidade de Santiago de Compostela (ES)) Victor Mendez Munoz (Port d'Informació Científica (PIC))

Description

The increasing availability of cloud resources is making the scientific community to consider a choice between Grid and Cloud. The DIRAC framework for distributed computing is an easy way to obtain resources from both systems. In this paper we explain the integration of DIRAC with a two Open-source Cloud Managers, OpenNebula and CloudStack. They are computing tools to manage the complexity and heterogeneity of distributed data center infrastructures which allow to create virtual clusters on demand including public, private and hybrid clouds. This approach requires to develop an extension to the previous DIRAC Virtual Manager Server, developed for Amazon EC2, allowing the connection with the cloud managers. In the OpenNebula case, the development has been based on the CERN Virtual Machine image with appropriate contextualization, while in the case of CloudStack, the infrastructure has been kept more general allowing other Virtual Machine sources and operating systems. In both cases, CernVM File System has been used to facilitate software distribution to the computing nodes. With the resulting infrastructure, users are allowed to use cloud resources transparently through a friendly interface like DIRAC Web Portal. The main purpose of this integration is a system that can manage cloud and grid resources at the same time. Users from different communities do not need to care about the installation of the standard software that is available at the nodes, nor the operating system of the host machine which is transparent to the user. In this paper we analyse the overhead of the virtual layer, with some tests comparing the proposed approach with the existing Grid solution.

Primary authors

Ricardo Graciani Diaz (University of Barcelona (ES)) Victor Manuel Fernandez Albor (Universidade de Santiago de Compostela (ES)) Victor Mendez Munoz (Port d'Informació Científica (PIC))

Co-authors

Adrian Casajus Ramo (University of Barcelona (ES)) Gonzalo Merino Arevalo (Centro de Investigaciones Energ. Medioambientales y Tecn. - (ES) Juan Jose Saborido Silva (Universidade de Santiago de Compostela (ES))

Presentation Materials