Integration of XRootD into the cloud infrastructure for ALICE data analysis

Not scheduled
15m
OIST

OIST

1919-1 Tancha, Onna-son, Kunigami-gun Okinawa, Japan 904-0495
poster presentation Track7: Clouds and virtualization

Speaker

Eygene Ryabinkin (National Research Centre Kurchatov Institute (RU))

Description

Cloud technologies allow easy load balancing between different tasks and projects. From the viewpoint of the data analysis in the ALICE experiment, cloud allows to deploy software using Cern Virtual Machine (CernVM) and CernVM File System (CVMFS), to run different (including outdated) versions of software for long term data preservation and to dynamically allocate resources for different computing activities, e.g. grid site, ALICE Analysis Facility (AAF) and possible usage for local projects or other LHC experiments. We present a cloud solution for Tier-3 sites based on OpenStack and CEPH distributed storage with an integrated XRootD based storage element (SE). One of the key features of the solution is that CEPH has been used as a backend for Cinder Block Storage service for OpenStack and in the same time as a storage backend for XRootD, with redundancy and availability of data preserved by CEPH settings. For faster and easier OpenStack deployment the PackStack solution, which is based on the Puppet configuration management system, is applied. CEPH installation and configuration chains are structured, converted to Puppet manifests and integrated into Packstack. This solution can be easily deployed, maintained and used even in small groups with limited computing resources and small organisations which usually have lack of IT support. The proposed infrastructure has been tested on two different clouds (SPbSU \& BITP) and integrates succesfully with the ALICE data analysis model. The present work is supported in part by Saint-Petersburg State University research grants 11.38.66.2012 and 11.38.197.2014.

Primary authors

Andrey Zarochentsev (St. Petersburg State University (RU)) Mr Dmitrii Batkovich (St.Petersburg State University) Mikhail Kompaniets (St. Petersburg State University (RU)) Oksana Shadura (National Technical Univ. of Ukraine "Kyiv Polytechnic Institute) Volodymyr Yurchenko

Co-author

Eygene Ryabinkin (National Research Centre Kurchatov Institute (RU))

Presentation materials