Help us make Indico better by taking this survey! Aidez-nous à améliorer Indico en répondant à ce sondage !

9–13 Jul 2018
Sofia, Bulgaria
Europe/Sofia timezone

Integrating a dynamic data federation into the ATLAS distributed data management system

10 Jul 2018, 16:00
1h
Sofia, Bulgaria

Sofia, Bulgaria

National Culture Palace, Boulevard "Bulgaria", 1463 NDK, Sofia, Bulgaria
Poster Track 7 – Clouds, virtualization and containers Posters

Speaker

Frank Berghaus (University of Victoria (CA))

Description

Input data for applications that run in cloud computing centres can be stored at remote repositories, typically with multiple copies of the most popular data stored at many sites. Locating and retrieving the remote data can be challenging, and we believe that federating the storage can address this problem. In this approach, the closest copy of the data is used based on geographical or other information. Currently, we are using the dynamic data federation, Dynafed, a software solution developed by CERN IT. Dynafed supports several industry standards for connection protocols, such as Amazon S3, Microsoft Azure and HTTP with WebDAV extensions. Dynafed functions as an abstraction layer under which protocol-dependent authentication details are hidden from the user, requiring the user to only provide an X509 certificate. We have set up an instance of Dynafed and integrated it into the ATLAS distributed data management system, Rucio. We report on the challenges faced during the installation and integration.

Primary authors

Frank Berghaus (University of Victoria (CA)) Tobias Wegner (Bergische Universitaet Wuppertal (DE)) Mario Lassnig (CERN) Dr Markus Ebert (MIT) Cedric Serfon (University of Oslo (NO)) Fernando Fernandez Galindo (TRIUMF (CA)) Rolf Seuster (University of Victoria (CA)) Randy Sobie (University of Victoria (CA)) Vincent Garonne (University of Oslo (NO))

Presentation materials