Help us make Indico better by taking this survey! Aidez-nous à améliorer Indico en répondant à ce sondage !

19–25 Oct 2024
Europe/Zurich timezone

Using S3 storage with xrootd vs Dynafed

TUE 38
22 Oct 2024, 15:18
57m
Exhibition Hall

Exhibition Hall

Poster Track 1 - Data and Metadata Organization, Management and Access Poster session

Speaker

Dr Marcus Ebert (University of Victoria)

Description

The HEP-RC group at UVic used Dynafed intensively to create federated storage clusters for Belle-II and ATLAS; which was used by worker nodes deployed on clouds around the world. Since the end of the DPM development also means the end of the development for Dynafed, xrootd was tested with S3 as backend to replace Dynafed. We will show similarities as well as major differences between the two systems as well as results of tests we run on both, for data transfers, checksum calculations as well as clustering of different endpoints. This may help other to efficiently make use of S3 storage as a WLCG site SE.

Primary author

Dr Marcus Ebert (University of Victoria)

Co-authors

Colson Driemel (University of Victoria) Randall Sobie (University of Victoria (CA)) Tristan Sullivan (University of Victoria)

Presentation materials