Help us make Indico better by taking this survey! Aidez-nous à améliorer Indico en répondant à ce sondage !

9–13 Jul 2018
Sofia, Bulgaria
Europe/Sofia timezone

An http data-federation eco-system with caching functionality using DPM and Dynafed

12 Jul 2018, 14:15
15m
Hall 8 (National Palace of Culture)

Hall 8

National Palace of Culture

presentation Track 4 - Data Handling T4 - Data handling

Speaker

Silvio Pardi (INFN)

Description

The implementation of Cache Systems in the computing model of HEP experiments enables to accelerate access to hot data sets by scientists, opening new scenarios of data distribution and enable to exploit the paradigm of storage-less sites.
In this work, we present a study for the creation of an http data-federation eco-system with caching functionality. By exploiting the volatile-pool concept introduced in the last version of Disk Pool Manager, we created a code plugged in the logic of a DPM Storage, able to simulate the cache behaviour. Then we used Dynafed as light federation system to aggregate a set of standard Grid Storages with the cache system. With the designed setup, clients asking for a file present on the Data-Grid, but located closer to the cache rather than to physical location of the file, are automatically redirected to the cache thanks to the action of the geo-plugin run by Dynafed.
As proof of the concept, we tested the whole system in a controlled environment within the Belle II computing infrastructure using a set of files located in production Storage Elements. Preliminary results demonstrate the proper functionality of the logic and encourage continuing the work.

Primary authors

Davide Michelino (Universita e INFN, Napoli (IT)) Silvio Pardi (INFN) Bernardino Spisso (INFN) Guido Russo (Universita e sezione INFN di Napoli (IT))

Presentation materials