Help us make Indico better by taking this survey! Aidez-nous à améliorer Indico en répondant à ce sondage !

14–18 Oct 2019
Amsterdam Science Park Congress Centre
Europe/Amsterdam timezone

Data Lake. Configuration and testing of distributed data storage systems.

18 Oct 2019, 09:50
25m
Turingzaal (Amsterdam Science Park Congress Centre)

Turingzaal

Amsterdam Science Park Congress Centre

Science Park 123 1098 XG Amsterdam The Netherlands 52°21'23"N, 4°57'7"E
Grid, Cloud & Virtualisation Grids, Clouds and Virtualisation

Speaker

Andrey Zarochentsev (St Petersburg State University (RU))

Description

The need for an effective distributed data storage has appeared important from the beginning of LHC, and this topic has become particularly vital in the light of the preparation for the HL-LHC run and the emergence of data-intensive projects in other domains such as nuclear and astroparticle physics.
LHC experiments have started an R&D within the DOMA project and we report the recent results related to the federated data storage systems configuration and testing. We will emphasize on different system configurations and various approaches to test storage federations. We are considering EOS and dCache storage systems as a backbone software for data federation and xCache for data caching. We’ll also report about synthetic tests and experiments specific tests developed by ATLAS and ALICE for federated storage prototype in Russia. Recently, the execution of the test has been automated and now it is conducted using the HammerCloud toolkit. Data Lake project launched in the Russian Federation in 2019 and its prospects will be covered distinctly.
ake project launched in the Russian Federation in 2019 and its prospects will be covered distinctly.

Speaker release Yes

Primary authors

Aleksandr Alekseev (M.V. Lomonosov Moscow State University (RU)) Alexei Klimentov (Brookhaven National Laboratory (US)) Mr Andrey Kirianov (NRC Kurchatov Institute PNPI (RU)) Andrey Zarochentsev (St Petersburg State University (RU)) Stephane Jezequel (LAPP-Annecy CNRS/USMB (FR)) Valeri Mitsyn (Joint Institute for Nuclear Research (RU)) Xavier Espinal (CERN)

Presentation materials