Indico celebrates its 20th anniversary! Check our blog post for more information!

8–12 Oct 2018
Casa de Convalescència UAB
Europe/Zurich timezone

A Data Lake Prototype for HL-LHC

10 Oct 2018, 10:00
25m
Aula Magna (Casa de Convalescència UAB)

Aula Magna

Casa de Convalescència UAB

Carrer de Sant Antoni Maria Claret, 171 08041 Barcelona Spain Phone: +34 935 81 74 01 41° 24' 49.33' 'N 2° 10' 38.94'' E 41.413702, 2.177482
Grid, Cloud & Virtualisation Grid, Cloud & Virtualisation

Speaker

Xavier Espinal (CERN)

Description

Evolving the current data storage, management and access models is the main challenge in WLCG and certainly in scientific computing for the coming years. HL-LHC will be exceeding what funding agencies can provide by an order of magnitude. Forthcoming experiments in particle physics, cosmology and astrophysics also foresee similar magnitudes in data volumes. The concepts of storage federations, data redundancy, transfer protocols and data access need to be revisited with the clear goal to reduce costs while providing the performance required by the experiments in the next decade.
In this contribution we are presenting the experience with a primary Data Lake prototype for WLCG implementing some of the main ideas behind a future concept of storage federations.

Primary authors

Presentation materials