29 November 2021 to 3 December 2021
Virtual and IBS Science Culture Center, Daejeon, South Korea
Asia/Seoul timezone

Data Handling Optimization in Russian Data Lake Prototype.

contribution ID 551
Not scheduled
20m
Apple (Gather.Town)

Apple

Gather.Town

Poster Track 1: Computing Technology for Physics Research Posters: Apple

Speaker

Aleksandr Alekseev (Universidad Andres Bello (CL))

Description

HENP experiments are preparing for HL-LHC era, which will bring an unprecedented volume of scientific data. This data will need to be stored and processed by collaborations, but expected resource growth is nowhere near extrapolated requirements of existing models both in storage volume and compute power. In this report, we will focus on building a prototype of a distributed data processing and storage system with a focus on optimizing the efficiency of computing resources by reducing overhead costs for accessing the processed data. The described prototype was created using the geographically distant Russian WLCG sites and university clusters. This report will present the main architectural ideas, deployment details, and test results.

Speaker time zone Compatible with Europe

Authors

Aleksandr Alekseev (Universidad Andres Bello (CL)) Alexei Klimentov (Brookhaven National Laboratory (US)) Andrey Kirianov (NRC Kurchatov Institute PNPI (RU)) Andrey Zarochentsev (St Petersburg State University (RU)) Danila Oleynik (Joint Institute for Nuclear Research (RU)) Tatiana Korchuganova (Universidad Andres Bello (CL))

Presentation materials