XRootD and FTS Workshop @ STFC UK

Session

XRootD Presentations

Sep 11, 2024, 2:00 PM

The Cosener's House

61. Catching Up With XRootD

Andrew Bohdan Hanushevsky (SLAC National Accelerator Laboratory (US))

9/11/24, 2:00 PM

Features and changes since the last workshop (5.5.4 to 5.7.1).

59. Catching Up With XRootD (Part 2)

Guilherme Amadio (CERN)

9/11/24, 2:30 PM

In this contribution, we discuss infrastructure updates to XRootD and other development topics.

62. XRootD Future Feature Plans

Andrew Bohdan Hanushevsky (SLAC National Accelerator Laboratory (US))

9/11/24, 2:50 PM

A roundup of planned features and improvmments.

63. Contributing to XRootD

Guilherme Amadio (CERN)

9/11/24, 3:10 PM

• XRootD Development Model
• Documentation and Submitting Patches
• GitHub Actions Continuous Integration
• Building and Running Tests Locally

84. Pelican and the OSDF Overview

Brian Paul Bockelman (University of Wisconsin Madison (US))

9/12/24, 9:00 AM

Pelican and the OSDF Overview

71. XCache news & upcoming changes [25 min]

Matevz Tadel (Univ. of California San Diego (US))

9/12/24, 9:30 AM

New resource monitoring infrastructure.
Purge plugin support.
Planned development:
- extensions of resource monitoring, planned and possible
- improvement of prefetching

86. The Pelican XrdCl plugin

Brian Paul Bockelman (University of Wisconsin Madison (US))

9/12/24, 9:55 AM

The Pelican XrdCl plugin

56. Stress testing an OSDF/Pelican/XrootD origin

Fabio Andrijauskas (Univ. of California San Diego (US))

9/12/24, 11:00 AM

We create a set of tests to test every hardware and software limit related to XrootD. The idea of this talk is to show the results of these tests. Moreover, it will show some OSDF statistics.

85. The Pelican Globus/HTTP/S3 OSS backend

Brian Paul Bockelman (University of Wisconsin Madison (US))

9/12/24, 11:20 AM

The Pelican Globus/HTTP/S3 OSS backend

57. Experince with XCache on HPC in Germany (CMS)

Robin Hofsaess (KIT - Karlsruhe Institute of Technology (DE))

9/12/24, 11:50 AM

With this contribution, I want to present our first production deployment of XCache for workflow and efficiency optimizations of CMS jobs at our local HPC cluster at KIT, HoreKa. The project is part of the preparations for the future German HEP computing strategy focusing on HPC contributions.
Our fully containerized setup is deployed on a login node of the cluster and uses a shared...

88. OSCER Status

Horst Severini (University of Oklahoma (US))

9/12/24, 12:20 PM

97. UK storage with XRootD

Alastair Dewhurst (Science and Technology Facilities Council STFC (GB))

9/12/24, 2:00 PM

UK Storage (XrdCeph, CephFS+XrooTD, XCAche, and VP)

91. CERN Central Monitoring Overview

Borja Garrido Bear (CERN)

9/12/24, 2:30 PM

A presentation on CERN Central Monitoring, showcasing how data gets ingested, processed, enriched, aggregated and stored in OpenSearch.

From OpenSearch storage, tools such as Grafana can leverage the data and create dashboards and plots.

75. Shoveler XRootD monitoring

Katy Ellis (Science and Technology Facilities Council STFC (GB))

9/12/24, 3:00 PM

The old XRootD monitoring 'GLED' has been turned off. It will be replaced with Shoveler. This presentation looks at the testing and validation of this software, as well as other XRootD monitoring status.

82. XRootD monitoring at Lancaster

Steven Simpson (Lancaster University)

9/12/24, 4:00 PM

We show how we've combined three means of monitoring of our gateways, and suggest some enhancements.

89. XRootD Monitoring Streams

Andrew Bohdan Hanushevsky (SLAC National Accelerator Laboratory (US))

9/12/24, 4:20 PM

The types of information avalable via XRootD Monitoring

90. Discussion: XRootD Monitoring: What's missing? What needs to change?

Andrew Bohdan Hanushevsky (SLAC National Accelerator Laboratory (US))

9/12/24, 4:30 PM

Discussion

87. Network isolation for multi-IP exposure in XRootD

Diego Davila (UCSD)

9/13/24, 9:00 AM

Outline:
- The need to expose multiple IPs
- Network namespaces for isolation
- Manual approach
- k8s/multus approach

Duration: 20 min Virtual Presentation

65. Optimising Vector Read requests for RAL disk storage

Alexander Rogovskiy (Rutherford Appleton Laboratory)

9/13/24, 9:20 AM

For a long time Ceph-based disk storage at RAL Tier-1 was not able to execute Vector Read requests effectively, causing problems for some VOs. The talk describes multiple changes that were made to the Xrootd-Ceph plugin and configuration to solve the problem.

60. XKIT for GridPP: (XRootD Kubentes Integration Testing for GridPP)

Dr Robert Andrew Currie (The University of Edinburgh (GB))

9/13/24, 9:50 AM

XRootD is a robust, scalable service that supports globally distributed data management for diverse scientific communities. Within GridPP in the UK, XRootD is used by the Astronomy, High-Energy Physics (HEP) and other communities to access >100PB of storage. The optimal configuration for XRootD varies significantly across different sites due to unique technological frameworks and site-specific...

81. Benchmarking XRootD: A Versatile Testing Framework for the Grid Community

Mariam Demir

9/13/24, 10:20 AM

As Tier 1 storage continues to expand, an increasing number of sites are contributing to the Worldwide LHC Grid, making efficient data transfer a critical component for big data analytics. XRootD is pivotal for scientific data management, facilitating seamless data movement and access across the 3 tiers. However, with the growing complexity and scale of grid infrastructures, it is essential to...

64. Load Balancing in XRootD

Jyothish Thomas (STFC)

9/13/24, 11:00 AM

To address the need for high transfer throughput seen for large datacentres using XRootD for projects such as the LHC experiments, it is important to make optimal and sustainable use of our available capacity. Load balancing algorithms play a crucial role in distributing incoming network traffic across multiple servers, ensuring optimal resource utilization, preventing server overload, and...

72. XRootd Http as web server for ROOT [10 + 10 min]

Matevz Tadel (Univ. of California San Diego (US))

9/13/24, 11:30 AM

Present motivation & possibilities.
Discussion on feasibility and required changes for prototype implementation.

99. On the use of XRootD in StorageD at the Rutherford Appleton Laboratory, UK

Emmanuel Bejide

9/13/24, 12:00 PM

StorageD is the data aggregator component within archiving systems that supports the work of the Diamond
Light Source (DLS) and the Centre for Environmental Data Analysis (CEDA) at the Rutherford Appleton
Laboratory (RAL). StorageD provides file ingest and recall services to scientists and engineers internationally
through DLS and CEDA. StorageD currently support ingest of over 100TB daily....

98. Deep Dive into XRootD Github Repo

Guilherme Amadio (CERN)

9/13/24, 1:30 PM

How to maneuver around the XRootD Github repository and find helpful treasures at every click.

74. CMS experiment overview of XRootD usage

Elizabeth Sexton-Kennedy (Fermi National Accelerator Lab. (US))

This talk will present an overview of the different components of XROOTD and how FTS/XRootd fits into the data management and transfer parts of our Computing Model.