XRootD and FTS Workshop @ JSI

Session

XRootd presentations

29 Mar 2023, 14:00

Jozef Stefan Institute

12. Welcome

Jan Jona Javorsek (Jozef Stefan Institute, Slovenia)

29/03/2023, 14:00

Welcome and logistics

14. XRootD Features

Andrew Bohdan Hanushevsky (SLAC National Accelerator Laboratory (US))

29/03/2023, 14:10

We will review the new XRootD features added since the last workshop.

21. What's up with the XRootD client

Michal Kamil Simon (CERN)

29/03/2023, 15:00

22. XRootD Release Schedule and Future Plans

Guilherme Amadio (CERN)

29/03/2023, 16:00

• Current release procedure/automation
• Discussion on development workflow
• Plans for 5.6 and 6.0 releases later this year
• Python bindings (drop Python2 for good, packaging work)

23. Evolution of XRootD Testing and CI Infrastructure

Guilherme Amadio (CERN)

29/03/2023, 16:20

• Recent CI developments (+Alpine, +Alma, -Ubuntu 18)
• Supported platforms and compilers
• Full (or almost full) migration from GitLab CI to GitHub Actions
• Test coverage and static analysis
• Plans for improving the docker-based tests, running them in CI

24. OU XRootD Site Report

Horst Severini (University of Oklahoma (US))

29/03/2023, 16:40

25. XRootD usage at GSI

Soren Lars Gerald Fleischer (GSI - Helmholtzzentrum fur Schwerionenforschung GmbH (DE))

29/03/2023, 16:55

26. Analysis of data usage at BNL

Hironori Ito (Brookhaven National Laboratory (US))

29/03/2023, 17:15

6. XRootD in the UK: ECHO at RAL-LCG2 and developments at Tier-2 sites

James William Walder (Science and Technology Facilities Council STFC (GB))

29/03/2023, 17:30

ECHO is the Ceph-backed erasure-coded object store, deployed at the Tier-1 facility RAL-LCG2. It’s frontend access to data is provided via XRootD - using the XrdCeph plugin via the libradosstriper library of Ceph, with a current usable capacity in excess of 40PB.
This talk will cover the work and experiences of optimising for, and operating in, Run-3 of the LHC, and the developments towards...

8. Open Science Data Federation - OSDF

Fabio Andrijauskas (Univ. of California San Diego (US))

30/03/2023, 09:30

All research fields require tools to be successful. A crucial tool today is the computer. The Open Science Grid (OSG) provides ways to access computational power from different sites. Open science data federation (OSDF) provides data access to the OSG pool using several software stacks. OSDF has received upgrades related to storage space, monitoring checks, monitoring stream collection, and...

16. To the OSPool and Beyond: The guts of the OSDF client

Brian Bockelman (Morgridge Institute for Research)

30/03/2023, 10:10

The Open Science Data Federation (OSDF) delivers petabytes of data each month to workflows running on the OSPool. To do so, one requires a reliable set of client tools. This presentation will take a look "under the hood" of the current OSDF client tooling, covering:

• Discovery of nearby cache instances.
• Acquisition of credentials for transfer, automated or otherwise.
• Experiences...

34. XCache Developments & Plans

Matevz Tadel (Univ. of California San Diego (US))

30/03/2023, 11:00

19. Experience with XCache in Virtual Placement

Ilija Vukotic (University of Chicago (US))

30/03/2023, 11:30

Virtual Placement is a way to approximate a CDN-like network for the ATLAS experiment. XCache is an important component in a Virtual Placement mechanism and is expected to substantially improve performance and reliability, while simultaneously decreasing bandwidth needed. I will explain how we configure it, deploy and use it, share experience in more than one year of running it.

3. Experience deploying xCache for CMS in Spain

Carlos Perez Dengra (PIC-CIEMAT)

30/03/2023, 12:00

Over the last few years, the PIC Tier-1 and CIEMAT Tier-2 sites in Spain have been exploring XCache as a content delivery network service for CMS data in the region. This service aligns with the WLCG data management strategy towards HL-LHC. The caching mechanism allows data to be located closer to compute nodes, which has the potential to improve CPU efficiency for jobs, especially for...

28. Getting the most out of XCache

Ilija Vukotic (University of Chicago (US))

30/03/2023, 12:20

1. Data-Aware Scheduling for Opportunistic Resources (with XRootD and HTCondor)

Robin Hofsaess (KIT - Karlsruhe Institute of Technology (DE))

30/03/2023, 14:00

In the talk, I want to present our ideas for a data-aware scheduling mechanism for our opportunistic resources attached to GridKa, the T1 center in Germany.
Opportunistic resources are non permanent computing sites (partly with cache storages) distributed in Germany that provide resources for the HEP community from time to time.
We are planning to implement a hash-based distribution of...

30. Kingfisher: Storage Management for Data Federations

Brian Paul Bockelman (University of Wisconsin Madison (US))

30/03/2023, 14:30

31. XRootD pgRead & pgWrite

Andrew Bohdan Hanushevsky (SLAC National Accelerator Laboratory (US))

30/03/2023, 14:50

32. XrdEc: the whole story

Michal Kamil Simon (CERN)

30/03/2023, 15:10

35. XRootD Plugins

Andrew Bohdan Hanushevsky (SLAC National Accelerator Laboratory (US))

30/03/2023, 16:00

5. Porting of XRootD to Windows as a part of EOS-wnc

Gregor Molan (Comtrade 360's AI Lab)

30/03/2023, 16:30

XRootD provides fast, low latency, and scalable data access. It also provides a hierarchical organization of a filesystem-like namespace organized as a directory. As part of CERN EOS, XRootD assures another possibility for a fast connection for data transfer between the client and the EOS FST.

This is the presentation of Comtrade's work at the CERN's project of productization of EOS, and...

36. A Brief History of the dCache Xroot Implementation (virtual)

ALBERT ROSSI (Fermi National Accelerator Laboratory)

30/03/2023, 17:00

18. RNTuple: ROOT's Event Data I/O for HL-LHC

Jakob Blomer (CERN)

31/03/2023, 09:30

This talk provides an introduction to RNTuple, ROOT's designated TTree successor. RNTuple is active R&D, available in the ROOT::Experimental namespace. Benchmarks using common analysis tasks and experiment AODs suggest a 3x - 5x better single-core performance and 10%-20 smaller files compared to TTree. The talk will specifically focus on RNTuple's I/O scheduling and optimization opportunities...

11. LHCOPN/LHCONE Status and Updates

Edoardo Martelli (CERN), Marian Babik (CERN)

31/03/2023, 10:00

In this talk we’ll give an update on the LHCOPN/LHCONE networks, current activities, challenges and recent updates. We will also focus on the various R&D projects that are currently on-going and could impact XRootD and FTS. Finally, we will also cover our plans for mini-challenges and major milestones in anticipation of the DC24.

2. Kubernetes and XrootD

Fabio Andrijauskas (Univ. of California San Diego (US))

31/03/2023, 10:20

Bioscience, material sciences, physics, and other research fields require several tools to achieve new results, discoveries, and innovations. All these research fields require computation power. The Open Science Grid (OSG) provides ways to access the computation power from different sites for several research fields. Besides the processing power, it is essential to access the data for all...

39. Outlook on EOS, the CERN storage solution for LHC Run3 and beyond

Guilherme Amadio (CERN)

31/03/2023, 11:00

53. A Prometheus XRootD exporter based on mpxstats (virtual)

Jan Knedlik (GSI - Helmholtzzentrum fur Schwerionenforschung GmbH (DE))

31/03/2023, 11:30

10. XRootD monitoring discussion

Matevz Tadel (Univ. of California San Diego (US))

31/03/2023, 11:40

30 minutes
10 minutes introduction
20 minutes discussion

29. Experience with XCache in Virtual Placement

Ilija Vukotic (University of Chicago (US))

20. Getting the most out of XCache

Ilija Vukotic (University of Chicago (US))

XCache grew to be a quite stable, performant and function rich caching server for the HEP community.
I will propose a few developments that could help its adoption, simplify and optimize its operation in large distributed systems.

9. XCache

Matevz Tadel (Univ. of California San Diego (US))

XCache overview
developments in 5.x
plans
30 minutes

27. XCache Developments & Plans

Matevz Tadel (Univ. of California San Diego (US))

33. XRootD Plugins

Andrew Bohdan Hanushevsky (SLAC National Accelerator Laboratory (US))