11–13 Mar 2024
CERN
Europe/Zurich timezone

Combining NextCloud with Direct Access to dCache at DESY

11 Mar 2024, 17:10
1m
503/1-001 - Council Chamber (CERN)

503/1-001 - Council Chamber

CERN

162
Show room on map

Speaker

Christian Voss

Description

The DESY Sync&Share Service is based on NextCloud and dCache as underlying storage system. It currently offers several $\mathtt{PiB}$ to customers at DESY and many other laboratories within the Helmholtz Association. Since DESY Sync&Share is also used to store and share scientific data a better integration into the scientific infrastructure is desirable.

Using dCache as backend storage allows for convenient direct access. The Sync&Share dCache can easily serve as a Grid storage element or Rucio storage element. Through different protocols such as NFS, XrooD or WebDAV data shared by other scientists can easily be analysed on the DESY compute clusters. An integration with services such as FTS is possible.

The challenge is the integration with NextCloud. Data not written through NextCloud directly is unknown to NextCloud. Through file-scans externally written data can be imported into NextCloud. However, dCache offers access and billing data about every file transfers. By passing these through an event streaming platform it is easy to trigger the registration.

In the talk we introduce the use cases at DESY, show the current setup and discuss limitations.

Authors

Christian Voss Peter van der Reest (Deutsches Elektronen-Synchrotron DESY) Mr Tigran Mkrtchyan (DESY) Tim Moeller

Presentation materials

There are no materials yet.