27–31 Mar 2023
Jozef Stefan Institute
Europe/Zurich timezone

To the OSPool and Beyond: The guts of the OSDF client

30 Mar 2023, 10:10
20m
Jozef Stefan Institute

Jozef Stefan Institute

Jamova cesta 39, 1000 Ljubljana, Slovenia

Speaker

Brian Bockelman (Morgridge Institute for Research)

Description

The Open Science Data Federation (OSDF) delivers petabytes of data each month to workflows running on the OSPool. To do so, one requires a reliable set of client tools. This presentation will take a look "under the hood" of the current OSDF client tooling, covering:

  • Discovery of nearby cache instances.
  • Acquisition of credentials for transfer, automated or otherwise.
  • Experiences maintaining the client in Go.
  • Integration with the HTCondor Software Suite.
  • Monitoring and telemetry of performance.

Finally, we'll cover the how we plan to make the client more usable, especially in applications beyond the OSPool, over the coming year.

Author

Brian Bockelman (Morgridge Institute for Research)

Presentation materials