Welcome talk: workshop logistics, Ljubljana survival guide and an introductory word from the head of the institute
Last year in review, showcasing the evolution of the FTS project, as well as touching on what's new in the FTS world, community engagement and the future direction.
This talk will present recent QoS improvements, go into the details of the Tape REST API and how it is implemented in FTS & Gfal2, showcase Gfal2 tape interaction over HTTP and finally, look at what's upcoming in the tape world, such as Archive Metadata and Tape REST API evolution.
This talk will describe the future strategy of tokens in FTS, as well as implementation milestones to fully integrated tokens into the FTS landscape.
The FTS3 @ CERN site report, presenting the number of instances, volume of data served each year, database setup and various operation tips and tricks discovered throughout the years.
An overview of the FTS3 deployment at BNL
- Outline
- Introduction
- Configurations
- CMS configuration – physical server
- Public configuration – containers
- Differences
- Advantages & disadvantages of each configuration
- Summary
This presentation will describe the usage of FTS by the CMS experiment at the Large Hadron Collider during the start of Run-3. I will describe the particular features recently developed for, and employed by CMS for our unique user case as well as current challenges and efforts to optimise performance on the boundary between FTS and Rucio. I will also discuss the future transfer requirements of CMS.
This talk focuses on the Rucio data management framework and its interaction with FTS.
An overview of the FTS-Alto project in collaboration with Dr. Richard Yang and his research group (Yale University)
The word "monitoring" is used everywhere in the FTS world. This talk wants to dive into the different types of monitoring present in the FTS world and explain what each of them means.
This talk will show an overview of the health and alarm metrics used at the FTS3@CERN deployment. The full lifecycle will be presented, from the software changes and scripts needed, to logging extraction via FluentBit and ultimately to the Grafana display.
An overview of the FTS-Noted project, aimed at shaping traffic through dynamic network switches.
We will review the new XRootD features added since the last workshop.
- Current release procedure/automation
- Discussion on development workflow
- Plans for 5.6 and 6.0 releases later this year
- Python bindings (drop Python2 for good, packaging work)
- Recent CI developments (+Alpine, +Alma, -Ubuntu 18)
- Supported platforms and compilers
- Full (or almost full) migration from GitLab CI to GitHub Actions
- Test coverage and static analysis
- Plans for improving the docker-based tests, running them in CI
ECHO is the Ceph-backed erasure-coded object store, deployed at the Tier-1 facility RAL-LCG2. It’s frontend access to data is provided via XRootD - using the XrdCeph plugin via the libradosstriper library of Ceph, with a current usable capacity in excess of 40PB.
This talk will cover the work and experiences of optimising for, and operating in, Run-3 of the LHC, and the developments towards...
All research fields require tools to be successful. A crucial tool today is the computer. The Open Science Grid (OSG) provides ways to access computational power from different sites. Open science data federation (OSDF) provides data access to the OSG pool using several software stacks. OSDF has received upgrades related to storage space, monitoring checks, monitoring stream collection, and...
The Open Science Data Federation (OSDF) delivers petabytes of data each month to workflows running on the OSPool. To do so, one requires a reliable set of client tools. This presentation will take a look "under the hood" of the current OSDF client tooling, covering:
- Discovery of nearby cache instances.
- Acquisition of credentials for transfer, automated or otherwise.
- Experiences...
Virtual Placement is a way to approximate a CDN-like network for the ATLAS experiment. XCache is an important component in a Virtual Placement mechanism and is expected to substantially improve performance and reliability, while simultaneously decreasing bandwidth needed. I will explain how we configure it, deploy and use it, share experience in more than one year of running it.
Over the last few years, the PIC Tier-1 and CIEMAT Tier-2 sites in Spain have been exploring XCache as a content delivery network service for CMS data in the region. This service aligns with the WLCG data management strategy towards HL-LHC. The caching mechanism allows data to be located closer to compute nodes, which has the potential to improve CPU efficiency for jobs, especially for...
In the talk, I want to present our ideas for a data-aware scheduling mechanism for our opportunistic resources attached to GridKa, the T1 center in Germany.
Opportunistic resources are non permanent computing sites (partly with cache storages) distributed in Germany that provide resources for the HEP community from time to time.
We are planning to implement a hash-based distribution of...
XRootD provides fast, low latency, and scalable data access. It also provides a hierarchical organization of a filesystem-like namespace organized as a directory. As part of CERN EOS, XRootD assures another possibility for a fast connection for data transfer between the client and the EOS FST.
This is the presentation of Comtrade's work at the CERN's project of productization of EOS, and...
In this talk we’ll give an update on the LHCOPN/LHCONE networks, current activities, challenges and recent updates. We will also focus on the various R&D projects that are currently on-going and could impact XRootD and FTS. Finally, we will also cover our plans for mini-challenges and major milestones in anticipation of the DC24.
Bioscience, material sciences, physics, and other research fields require several tools to achieve new results, discoveries, and innovations. All these research fields require computation power. The Open Science Grid (OSG) provides ways to access the computation power from different sites for several research fields. Besides the processing power, it is essential to access the data for all...
30 minutes
10 minutes introduction
20 minutes discussion
XCache grew to be a quite stable, performant and function rich caching server for the HEP community.
I will propose a few developments that could help its adoption, simplify and optimize its operation in large distributed systems.
A cornerstone of translating the raw capacity of a distributed system into an effective source of shared computing power is the methodical management of all the resources. While one commonly thinks of managing processing resources - CPUs, GPUs, memory - there's surprisingly little attention paid to the management of storage resources. Questions abound: How much storage should be set aside? ...
XCache overview
developments in 5.x
plans
30 minutes
