12–16 Oct 2020
Online Workshop
Europe/Paris timezone

Running event-driven workflows with dCache storage events

15 Oct 2020, 10:30
20m
Online Workshop

Online Workshop

Grid, Cloud & Virtualisation Grids, Clouds and Virtualisation

Speaker

Mr Bastien Gounon (CC-IN2P3 / CNRS)

Description

dCache is an open-source distributed storage system for scientific use cases, actively used by large-scale experiments, including within the WLCG community. In 2018, developers started to introduce the concept of storage events within dCache. We are going to present this concept and see how it can be used to trigger automated workflows, with the example of a proof-of-concept implemented at CC-IN2P3 to help with the LSST image simulation campaign. Finally, we will see how events can be used to transform the way we currently manage infrastructure and workloads when paired with function-as-a-service computing, a new way to deploy highly flexible, automated and smart services.

Primary author

Mr Bastien Gounon (CC-IN2P3 / CNRS)

Presentation materials