21-25 May 2012
New York City, NY, USA
US/Eastern timezone

The CC1 project - Cloud Computing for Science

22 May 2012, 13:30
4h 45m
Rosenthal Pavilion (10th floor) (Kimmel Center)

Rosenthal Pavilion (10th floor)

Kimmel Center

Poster Distributed Processing and Analysis on Grids and Clouds (track 3) Poster Session

Speaker

Mr Milosz Zdybal (Institute of Nuclear Physics)

Description

Providing computer infrastructure to end-users in an efficient and user-friendly way was always a big challenge in the IT market. “Cloud computing” is an approach that addresses these issues and recently it has been gaining more and more popularity. A well designed Cloud Computing system gives elasticity in resources allocation and allows for efficient usage of computing infrastructure. The underlying virtualization technology and the self-service type of access are the two key features that make the software independent of the specific hardware and enable a significant decrease in system administration effort. The growing popularity of cloud computing led to the appearance of many open source systems offering cloud computing environments, such as Eucalyptus, OpenNebula, Nimbus or OpenStack. These solutions make it possible to construct a computing cloud in a relatively short time and do not require a deep understanding of virtualization techniques and network administration. The main drawback of using this type of toolkits is a difficulty in customization to special needs. A significant effort is needed to implement some non standard features. The CC1 Project started in 2009. The proposed solution is based on Libvirt, a lower level virtualization toolkit. It provides a full set of VM management actions on a single node. For the top layer the PYTHON programming language was chosen as it ensures fast development environment (interpreter) and offers a number of useful modules. At present most of the required features are being implemented: • custom web-based user interface, • automatic creation of virtual clusters (“farms”) with preconfigured batch system, • groups of users with the ability to share resources, • permanent virtual storage volumes that can be mounted to a VM, • distributed structure – federation of clusters running as a uniform cloud, • quota for user resources, • monitoring and accounting system. The CC1 system consists of two main layers. The top element of the system is called Cloud Manager (CLM). It receives calls from user interfaces (web browser based interface or EC2 interface) and passes commands to Cluster Managers (CMs). Cluster Manager, running on each individual cluster, handles all low-level operations required to control virtual machines. The project is close to reach its first milestone. The production quality system (Private Cloud) will be made available to researchers of IFJ PAN at the beginning of 2012. The next step is to build federated systems with universities that expressed their interest in the project. The CC1 system will be described and the experience from the firsts months of its usage will be reported.

Primary authors

Mariusz Witek (Polish Academy of Sciences (PL)) Mr Milosz Zdybal (Institute of Nuclear Physics)

Co-authors

Dr Andrzej Olszewski (Polish Academy of Sciences (PL)) Bartlomiej Henryk Zabinski (Polish Academy of Sciences (PL)) Mr Danielowski Krzysztof (Institute of Nuclear Physics PAN) Mr Grzymkowski Rafal (Institute of Nuclear Physics PAN) Janusz Chwastowski (Polish Academy of Sciences (PL)) Mr Maciej Kruk (Institute of Nuclear Physics) Maciej Piotr Nabozny (Cracow University of Technology) Mr Piotr Wojcik (Institute of Nuclear Physics) Mr Przemyslaw Syktus (Institute of Nuclear Physics PAN) Mr Tomasz Sosnicki (Institute of Nuclear Physics) Mr Tomasz Wojton (Institute of Nuclear Physics PAN)

Presentation Materials

There are no materials yet.