WLCG/HSF Workshop 2025

5 May 2025, 12:00 → 9 May 2025, 14:35 Europe/Paris

Auditorium P. Lehmann, Building 200 (IJCLab, Paris)

Welcome to the WLCG/HSF Workshop 2025 at IJCLab (Orsay, France), May 5-9 2025

The 2 conference rooms for the workshop are:

• Auditorium Pierre Lehmann, located in building 200
• Auditorium Joliot Curie, located in building 100

WLCG/HSF Workshop @IJCLab

Monday 5 May

Plenary: Registration + Welcome Drink

Plenary: Opening

Conveners: Michel Jouvin (Université Paris-Saclay (FR)), Simone Campana (CERN)

1 Welcome in Orsay

Speakers: Michel Jouvin (Université Paris-Saclay (FR)), Valerie CHAMBERT

IJCLab-Presentation-WLCG-HSFworkshop.pdf

Logistics.pdf

2 Introduction - WLCG

Speakers: David Britton (University of Glasgow (GB)), Simone Campana (CERN), Tommaso Boccali

WLCG-Workshop-2025-intro.pdf

WLCG-Workshop-2025-intro.pptx

3 Introduction - HSF

Speakers: Eduardo Rodrigues (University of Liverpool (GB)), Paul James Laycock (Universite de Geneve (CH))

HSF Introduction_ WLCG_HSF 2025.pdf

Plenary: AI and WLCG/HSF

Conveners: Alessandro Di Girolamo (CERN), Paul James Laycock (Universite de Geneve (CH))

4 AI & WLCG/HSF - scope of the session

Speakers: Alessandro Di Girolamo (CERN), Paul James Laycock (Universite de Geneve (CH))

5 AI and Facilities

Speaker: Ilija Vukotic (University of Chicago (US))

AI for Facilities

15:15 coffee/tea break

6 AI/ML for Physics use cases

Speaker: Tommaso Boccali

WLCG Paris AI 2025.pdf

WLCG Paris AI 2025.pptx

7 Heterogeneous resources and experiment software

Speaker: Paolo Calafiura (Lawrence Berkeley National Lab. (US))

Paolo GPU WLCG.pptx (1).pdf

8 Facility view: Heterogeneous resources deployment and usage

Speakers: Ben Jones (CERN), Rodney Walker (Ludwig Maximilians Universitat (DE))

WLCG_GPU(1).pdf

9 Discussion

Social event: Welcome reception

Tuesday 6 May

08:30 Welcome coffee

HSF: Common software and Software Projects

Convener: Stefan Roiser (CERN)

Live slides

10 ROOT: Taking stock of the Run 3 experience towards ROOT7

ROOT is a unified software package for the storage, processing, and analysis of scientific data: from its acquisition to the final visualization in the form of highly customizable, publication-ready plots. Successfully used by experiments and thousands of physicists, the ROOT Project is preparing its seventh release cycle, sustained by intense R&D activities.
In this contribution, after briefly reviewing the status of the project, we’ll focus on the results harvested along the R&D activities conducted so far and how those will shape the future of ROOT. The areas on which we’ll concentrate will mainly be three. Firstly, we discuss how hardware accelerators can be exploited by users with ROOT and how these new features are relevant at present and future Analysis Facilities. Then, we review the current development status of RNTuple and its adoption by experiments, illustrating both advancements in terms of performance but also usability, in C++ and Python. Finally, we’ll concentrate on the Python-C++ integration, at a low level, and the recent advancements in the interoperability of ROOT and Scientific Python, at the user-facing level.

Speaker: Danilo Piparo (CERN)

250506 - ROOT- Taking stock of the Run 3 experience towards ROOT7.pdf

11 Latest Developments in RooFit and Plans

RooFit is a software package written in C++ for statistical data analysis that is part of ROOT. It is widely used in the High Energy Physics (HEP) community, with the most prominent users being the LHC collaborations. Recent RooFit development has focused on performance improvements and supporting new statistical analysis approaches to enable cutting-edge analyses, such as combined Higgs measurements with ATLAS or CMS. In this contribution, the development pillars that helped to achieve this goal are elaborated on. The first pillar is code optimization and refactoring to optimally use both CPU and GPU resources. Then, there is supporting Automatic Differentiation (AD) with Clad, a compiler plugin for Clang. Furthermore, RooFit now provides new Python interfaces to include ML models as likelihood surrogates, enabling Simulation-Based Inference (SBI). Finally, this contribution will also report on the development status of the Minuit2 library for numerical minimization since it is a key dependency of RooFit, and the two packages are developed hand-in-hand to implement performance-optimal statistical analysis workflows for HEP.

Speaker: Jonas Rembser (CERN)

RooFit WLCG_HSF 2025.pdf

12 Introduction to the Virtual Research Environment: an end-user perspective

One of the objectives of the EOSC (European Open Science Cloud) Future Project was to integrate diverse analysis workflows from Cosmology, Astrophysics and High Energy Physics in a common framework. This led to the inception of the Virtual Research Environment (VRE) at CERN, a prototype platform supporting the goals of Dark Matter and Extreme Universe Science Projects in compliance with FAIR (Findable, Accessible, Interoperable, Reusable) data policies. The goal of the project was to highlight the synergies between different dark matter communities and experiments, by producing new scientific results as well as by making the necessary data and software tools fully available. The VRE makes use of a common authentication and authorisation infrastructure (AAI), and shares the different experimental data (ATLAS, Fermi-LAT, CTA, Darkside, Km3Net, Virgo, LOFAR) in a reliable distributed storage infrastructure via the ESCAPE Data Lake. The entry point of such a platform (for an end-user) is a jupyterhub instance deployed on top of a scalable Kubernetes infrastructure, providing an interactive graphical interface for researchers to access, analyse and share data. The data access and browsability is enabled through API calls to the high level data management and storage orchestration software (Rucio). The VRE aims to streamline the development of end-to-end physics workflows, granting researchers access to an infrastructure that contains easy-to-use physics analysis workflow from different experiments. In this contribution, I will provide an overview of the VRE, highlight its use cases as an analyser for implementing and reproducing experimental analyses on a REANA cluster, and showcase the successful integration of an ATLAS experimental analysis workflow into the VRE platform.

Speaker: Sukanya Sinha (The University of Manchester (GB))

WLCG2025_VRE_SSInha.pdf

10:30 Coffee break

13 Accelerating HEP detector simulations using G4HepEm

Geant4 based detector simulations make a significant contribution to the overall computing budget of the LHC experiments. The individual experiments have been investing considerable effort in making their simulations more and more efficient. These performance optimisations are now even more important in order to cope with the special computing challenges of the HL-LHC era.

G4HepEm is one of the R&D projects that have been launched with the goal of contributing to this effort. It provides an efficient simulation of the electromagnetic shower, tailored for HEP detector simulations, in the form of a Geant4 extension. A significant performance improvement (~20 %) of the ATLAS and CMS full detector simulations has been achieved recently after integrating G4HepEm into the ATLAS Athena and CMS-SW frameworks while preserving the accuracy of the results. The motivations, ideas and results obtained for ATLAS and CMS will be presented.

Speaker: Mihaly Novak (CERN)

m_novak_G4HepEm_6_05_2025_WLCG-HSF-Paris.pdf

14 AdePT - Offloading electromagnetic showers in Geant4 simulations to GPU

The Geant4 simulation throughput of LHC experiments is limited by increasing detector complexity in the high-luminosity phase. As high-performance computing shifts toward heterogeneous architectures such as GPUs, GPU-accelerated particle transport simulations offer a potential way to improve performance. Currently, only electromagnetic showers can be offloaded to GPUs, making an efficient CPU–GPU workflow essential. In this contribution, we present state-of-the-art detector simulations for LHC experiments using GPUs, outline the outstanding challenges, and discuss future directions.

Speaker: Severin Diederichs (CERN)

SDiederichs_AdePT_HSFWLCG_workshop_2025.pdf

WLCG: Facilities

Conveners: James Letts (Univ. of California San Diego (US)), Julia Andreeva (CERN)

Live Notes

Live Notes for WLCG Workshop

15 Summary of the HEPiX Spring 2025 Workshop

Speaker: Jose Flix Molina (CIEMAT - Centro de Investigaciones Energéticas Medioambientales y Tec. (ES))

20240506_WLCG_HSF_Workshop_HEPiX_Summary (1).pdf

16 Status and evolution of French sites

Speaker: Laurent Duflot (CNRS (FR))

WLCG-French-Sites.pdf

17 Storage relocation: INFN-CNAF experience

Speaker: Andrea Rendina

Storage relocation - INFN-CNAF experience.pdf

Storage relocation - INFN-CNAF experience.pptx

10:30 Coffee break

WLCG: Token Migration Plan

Conveners: Alessandro Di Girolamo (CERN), Panos Paparrigopoulos (CERN)

Live Notes

Live Notes for WLCG Workshop

18 Token Transition Overview

Speaker: Maarten Litmaath (CERN)

Token_Transition_Overview-250506-v11.pdf

Token_Transition_Overview-250506-v11.pptx

19 Tape REST API, Tokens & FTS: A Unified Proposal

Speaker: Mihai Patrascoiu (CERN)

WLCG_HSF_Workshop2025_FTS_Tape_REST_API_Unified_Proposal.pdf

20 Discussion

12:30 Lunch

Plenary: Analysis at scale and analysis challenges

Conveners: Alessandra Forti (The University of Manchester (GB)), Dr Nicole Skidmore (University of Warwick)

21 Responding Faster: Lessons from a security incident

NOTE: this contribution was actually part of the Facilities session, which overflowed into the afternoon.

Speaker: Jose Carlos Luna Duran (CERN)

WLCG-HSF-2025-05-redacted.pdf

22 User experience

A users perspective on typical problems faced throughout an analysis cycle, the ad-hoc solutions implemented, and the limited view a user has of the Grid and how it is displayed to them.

Speaker: Albert Gyorgy Borbely (University of Glasgow (GB))

WLCG_HSF_25.pdf

23 CMS analysis facility contribution

Speaker: Oksana Shadura (University of Nebraska Lincoln (US))

AF_CMS_May-3.pdf

24 ATLAS analysis facility contribution

Speaker: Emma Torro Pastor (Univ. of Valencia and CSIC (ES))

2025-05-06-AnalysisInfrastructures_ATLAS.pdf

25 Understanding the scale of HL-LHC physics analyses

The existing roadmaps and computing model plans from ATLAS and CMS for the HL-LHC area are primarily focused on the centralized aspect of computing: those steps that lead up to sets of files made available to physicists for analysis. The general approaches, resources used, and software frameworks for the area of “end-user physics analysis”, which starts from those files, are much less clearly defined, understood, or prescribed.

In order to better understand these aspects, IRIS-HEP, jointly with ATLAS AMG, CMS CAT and HSF DAAA, is designing a survey to capture the computational requirements from physics analysis use cases. This contribution will show first results from the survey and discuss the broader context of the effort. Following this survey, we aim to identify a set of physics analyses and define benchmark scenarios to extrapolate the concrete computing requirements to the HL-LHC era. The described workflows will provide more clarity about the role of analysis facilities and the kinds of services they should make available. It will allow for quantitative evaluation of analysis models and be a first step towards identifying what to do about analysis use cases that do not fit into the space set out by the benchmark examples.

Speakers: Alexander Held (University of Wisconsin Madison (US)), Oksana Shadura (University of Nebraska Lincoln (US))

20250506_WLCG_HSF_HL_LHC_analysis.pdf

15:30 Coffee break

26 LHCb analysis facility contribution

Speaker: Dr Nicole Skidmore (University of Warwick)

HSF-WLCG-2025-talk (3).pdf

27 ALICE analysis facility contribution

Speaker: Maarten Litmaath (CERN)

ALICE-Analysis-Facilities-250506-v11.pdf

ALICE-Analysis-Facilities-250506-v11.pptx

28 Exploiting extremely-parallel technologies for future large-scale physics analyses demands

The HEP experiments and community face complex computing and storage requirements which are expected to increase by several factors with the advent of HL-LHC. By the end of Run3, the machine will have accumulated roughly 10% of the total dataset. These data, stored in the ROOT data format, are then analysed by the various experiment communities, with varying levels of coordination and centralisation.

Very often, the computational complexity of these physics analyses is such that parallelisation must be employed to ensure a reasonable time-to-insight for the physicists. Batch computing on the grid is a well-oiled workflow that has enabled obtaining a plethora of important physics results. In recent times, interactive scheduling approaches have emerged that lower the programming entry barrier and allow for a more ergonomic end-user experience. In this context, a specific combination of storage, computing resources, software distribution and distributed engines can be identified and is sometimes referred to as an "analysis facility".

In this contribution, we highlight existing technologies such as ROOT, SWAN, EOS, XRootD and others that represent concrete building blocks available in production today to help the community in addressing the expected complexity of HL-LHC analyses. We also display how various current and future physics use cases can benefit from such technologies. These are used both in analyses facilities and other distributed computing infrastructures to minimise the time-to-insight and enable ergonomic and user-friendly distributed computing.

Speaker: Jonas Rembser (CERN)

root_distributed_analysis.pdf

29 Proposal for Interdisciplinary Analysis Facilities

Next to HEP other scientific communities have emerged producing large amounts of data and requier correspondingly processing power. While Analysis Facilities can be optimized to specific workflows, the underlying risk is a highly specialised and inflexible lock-in. By aiming for an interdisciplicary approach concentrating on established industry standards and establishing generic interfaces, Analysis Facilities can profit from a broader usage scope.

Speaker: Thomas Hartmann (Deutsches Elektronen-Synchrotron (DE))

interdisciplinary_AFs.pdf

30 Analysis at the HL-LHC: Data Delivery, ServiceX, and Addressing Our Analysis Challenges

As the HL-LHC era approaches, the scale and complexity of data present challenges for analysis workflows within ATLAS and other HL-LHC experiments. This contribution reports on recent developments in ServiceX, a cross experiment utility, and its role as a data delivery and transformation service within the analysis ecosystem. Designed to bridge the gap between centrally produced datasets and user-level analysis code, ServiceX now supports a broader range of input formats—including custom non-ROOT ATLAS data—and has seen significant improvements in reliability, scalability, and ease of use.

We highlight progress in several areas: improved bullet-proofing of the data transformation infrastructure to avoid errors at scale; new convenience utilities for introspecting datasets (e.g., listing available branches); and tighter integration with common ATLAS frameworks such as TopCPTools, enabling more standardized analysis environments. We also share results from recent scaling tests demonstrating performance at analysis-scale workloads, and discuss how ServiceX fits into the broader analysis software stack, helping to address long-standing challenges of reproducibility, data access, and user efficiency.

This talk will provide a view of the design of ServiceX, the technical and usability gains made in recent months, and what’s coming next as we prepare for the HL-LHC's analysis demands.

Speaker: Gordon Watts (University of Washington (US))

2025-05-06 - ServiceX.pdf

2025-05-06 - ServiceX.pptx

Wednesday 7 May

08:30 Welcome coffee

HSF: Sustainable Software

Convener: Paul James Laycock (Universite de Geneve (CH))

Live slides

31 The European Virtual Institute for Research Software Excellence (EVERSE)

The EVERSE EU-funded project aims to create a framework for research software and code excellence, collaboratively designed and championed by research communities that include physics and astronomy.
EVERSE’s ultimate ambition is to contribute towards a cultural change where research software is recognized as a first-class citizen of the scientific process and the people that contribute to it are credited for their efforts.

In this contribution, we will outline the aims of the network and present the achievements of the first year of the project, towards building a European network of Research Software Quality and setting the foundations of a future Virtual Institute for Research Software Excellence, including the creation of the EVERSE Network. The goal of this contribution is also to interactively discuss how these best practices can map to the HSF’s sponsored project requirements.

Speaker: Graeme A Stewart (CERN)

EVERSE-Overview-WLCG-HSF-2025.pdf

EVERSE-Overview-WLCG-HSF-2025.pptx

32 The EVERSE/ESCAPE use cases: evaluating and improving the quality of HEP software

This contribution will present how the EVERSE project interfaces with the European Open Science Clusters (ENVRI-FAIR for environmental sciences, Life Sciences RI, ESCAPE for Particle physics and astrophysics, PaNOSC for Photon and neutron science and SSHOC for social sciences and humanities) through use cases of software packages or infrastructures that are in current used by researchers.

It is through these use cases that EVERSE draws best practices from the different communities, and where the various elements of the software excellence framework are tested and implemented prior to their release to the wider community. In this talk, we will describe the three ESCAPE use cases, highlight the elements that these use cases have contributed to EVERSE so far, and outline the expected improvements and pathway to obtain them by the end of the project in 2027.

Speakers: James Smith (The University of Manchester (GB)), Michael Philip Sparks (The University of Manchester (GB)), Tobias Fitschen (The University of Manchester (GB))

20250507.RSQKit-michaelsparks.pdf

33 The EVERSE Research Software Quality Toolkit

The Research Software Quality Toolkit (RSQKit - https://everse.software/RSQKit/), developed by the EVERSE project, lists curated best practices in improving the quality of your research software. It is intended for use by researchers, research software engineers, as well as those running research infrastructures involving software or involved in research software-related policy and funding.

These practices are informed by software excellence and quality in the context of research; with a focus on FAIR software, Open Research, community development and software engineering practices at different tiers of research software (analysis scripts, prototype tools and research software infrastructure). RSQKit links to tools and resources which support best practices. It includes software quality dimensions and links to indicators and tasks to guide the usage of the best practice, as well as links to training resources and existing guides and materials.

This contribution will introduce RSQKit and its aims and architecture. It is presented in a way to attract and consider feedback from researchers who code from the particle physics community and from WLCG infrastructure experts.

Speaker: Michael Philip Sparks (The University of Manchester (GB))

20250507.RSQKit-michaelsparks.pdf

10:30 Coffee break

34 Scikit-HEP project news and future directions

Scikit-HEP is a community-driven and community-oriented project with the goal of providing an ecosystem for particle physics data analysis in Python fully integrated with the wider scientific Python ecosystem. The project provides many packages and a few “affiliated” packages for data analysis. It expands the typical Python data analysis tools for particle physicists, with packages spanning the spectrum from general scientific libraries for data manipulation to domain-specific libraries. An overview of where the project is will be presented. Future developments and matters of sustainability will be discussed.

Speaker: Eduardo Rodrigues (University of Liverpool (GB))

2025-05-07_WLCG-HSF-IJCLabWorkshop_Scikit-HEP.pdf

35 Marionette: Data Structure Description and Management for Heterogeneous Computing

Marionette is a header-only C++ library that was designed to allow the description of arbitrary data structures that can work across heterogeneous compute devices and on the host, providing complete interoperability and convenient interfaces with no impact on runtime performance. This is achieved by decoupling the description of the data to be held from the way in which data will be stored, which enables the generation of all memory allocations, transfers and deallocations at compile-time without requiring the end user to write any sort of boilerplate code, achieving the same performance as the equivalent hand-written alternatives. Furthermore, an expressive and intuitive object-oriented interface can be offered on both host and device(s), especially since arbitrary functions can be added to the interface of both the individual objects and the entire collection of them, without any runtime performance penalty as everything is resolved at compile-time. This user-extensible interface also means that the behaviour of pre-existing data structures can be replicated, allowing for immediate porting of pre-existing code with only minor adjustments to the data types. Furthermore, since the user can override and further specialize data transfers, gradual porting to the new data structures with minimal performance loss becomes possible as efficient ways to convert to and from pre-existing structures can be provided. With a focus on flexibility, customisability and extensibility without compromising expressivity, convenience or ease of use, Marionette is designed to offer a general solution for expressing data structures, catering to a wide variety of use cases and levels of expertise, with little to no runtime impact.

Speaker: Nuno Dos Santos Fernandes (Laboratory of Instrumentation and Experimental Particle Physics (PT))

HSF Workshop - Marionette - Nuno Fernandes.pdf

36 Julia: Sustainability and Efficiency

There a number of studies of the general energy efficiency of different
programming languages, however relatively few look at HEP specific examples.
Here we present examples comparing energy efficiency of different jet
reconstruction codes in different languages: specifically C++, Julia and Python.
We also study the evolution of efficiency over recent releases of Julia and
Python.

We also discuss general aspects of sustainability of code and show how the Julia
language and ecosystem helps developers to write and maintain modular,
interoperable codes that reduce the code maintenance burden.

We show that Julia is an excellent language choice, combining outstanding energy
efficiency and human productivity, helping sustainability in all the most
meaningful senses.

Speaker: Graeme A Stewart (CERN)

Julia Efficiency Sustainability.pdf

WLCG: Open Technical Coordination Board (TCB#4)

Conveners: Alessandro Di Girolamo (CERN), James Letts (Univ. of California San Diego (US))

Live Notes

Live Notes for WLCG Workshop

37 WLCG Technical Roadmap - introduction

Speakers: Alessandro Di Girolamo (CERN), James Letts (Univ. of California San Diego (US))

250507 - WLCG Technical Coordination #4.pdf

38 Technical Roadmap - setting the scene - estimates of requirements for Run4 and Run5

Speaker: Ben Couturier (CERN)

20250507-WLCG-TR-Requirements-3.pdf

39 Technical Roadmap - setting the scene - estimates on capacity increase at flat budget scenario

Speaker: Dr Andrea Sciabà (CERN)

Technology Tracking WLCG - v1.0.pdf

Technology Tracking WLCG - v1.0.pptx

40 Discussions on the structure and the content of the chapters

Speakers: Alessandro Di Girolamo (CERN), James Letts (Univ. of California San Diego (US))

250507 - TCB#4 Discussion.pdf

Draft - Milestones - to be filled

Draft - Milestones - to be filled

Draft - WLCG Tech Roadmap Structure - for comments

Draft - WLCG Tech Roadmap Structure - for comments

10:30 Coffee break

41 Discussions on the structure and content of the chapters

Speakers: Alessandro Di Girolamo (CERN), James Letts (Univ. of California San Diego (US))

12:30 Lunch

HSF: Training Working Group

Convener: Michel Hernandez Villanueva (Brookhaven National Laboratory (US))

Live slides

42 Overview, goals

Speaker: Michel Hernandez Villanueva (Brookhaven National Laboratory (US))

WLCG_HSF Workshop 2025 - Introduction.pdf

43 The EVERSE training and recognition plan

The EVERSE project aims to collect, enhance and curate training resources aligned with domain-specific practices, create a long-term training activity supported by community services and platforms and establish a framework for recognizing Trainers and RSEs.

This contribution will describe how EVERSE plans to collect and provide training, guidance and education to researchers, software developers, and other stakeholders in the research community to help them understand the importance of software and code quality, as well as how to apply established best practices and standards for assessing, verifying, and improving the quality of their software and code.
We will describe the registry of training initiatives compiled so far, and how this registry will be maintained and presented through the TESS infrastructure. We will also outline recent activities in terms of recognition of software activities and roles.

Our aim is to get feedback from the community at the workshop and to highlight missing aspects in training and recognition that we can bring back to the project.

Speaker: Kenneth Brian Rioja (IT-FTI)

wlcghsf2025_eversetrainingrecognition_rioja.pdf

wlcghsf2025_eversetrainingrecognition_rioja.pptx

44 GWOSC and gravitational-wave data analysis training

Since their discovery in 2015, gravitational waves have become a hot topic in physics research.
Gravitational-wave data produced by the LVK Collaboration, formed by the LIGO, Virgo and KAGRA collaborations, become fully public after a grace period; combined with the relative simplicity of the data themselves (one time series of the main signal channel per each interferometer, plus some simple data quality information), this created a large community of professional scientists, students and even citizen scientists analyzing them.
The Gravitational-Wave Open Science Centre (gwosc.org), besides maintaining a site hosting the public data and relevant software, developed a large amount of training and teaching materials such as tutorials and documentation, and organises periodical GW Open Data Workshops, “crash courses” in GW data analysis. This contribution describes such materials and activities.

Speakers: Massimiliano Razzano, Dr Stefano Bagnasco (Istituto Nazionale di Fisica Nucleare, Torino)

15:30 Coffee break

45 Training on sustainable computing at DESY

A few years ago, primarily young scientists of the DESY particle physics division founded a forum for sustainability to enhance awareness of the environmental impact of research and to propose measures to reduce the energy footprint. Since computing is a substantial consumer of resources in particle physics, the forum initiated a series of workshops on computing with the aim of training scientists in best practices for efficient computing and software. Roughly twice per year, there is a workshop for beginners and newcomers to DESY with an introduction to the local computing facilities and hands-on exercises employing tools like ROOT, Git, and HTCondor. About once per year, there is a workshop on a slightly more advanced topic, such as software testing and performance, or using and building containers. The workshops are organized by a team of scientists from the IT department and from the experimental groups. All exercises are constructed along examples that are typical for particle physics and employ, e.g., CMS Open Data.

Speaker: Christoph Wissing (Deutsches Elektronen-Synchrotron (DE))

Training_on_Sustainable_Computing_at DESY_WLCGWorkshop_2025.pdf

46 User Learning for ePIC

The ePIC Software User Learning group supports the ePIC Collaboration by providing resources and opportunities for new user onboarding, software training events, and maintaining documentation. The ePIC Software employs a User-Centered Design model and supports the detector simulation and geometry design, analysis of physics and event reconstruction, and provides benchmarks to ensure a cohesive and consistent framework is available to users. This talk will discuss the strategies and resources available so far for developers with plans for future growth and support.

Speaker: Holly Szumila-Vance (Florida International University)

wlcg_workshop_2025.pdf

47 HOWTO Train: the HSF Training experience

The HSF Training group has built a fruitful learning environment within the high-energy and nuclear physics community through the organization of numerous training events. This talk will share practical insights gained from years of experience in planning and executing training events. We have learnt that organizing effective training requires careful planning, continuous adaptation, and the crucial role of community feedback. We will highlight strategies for engaging participants, adapting to diverse skill levels, and building a sustainable training ecosystem that upskill the next generation of researchers and software developers.

Speaker: Michel Hernandez Villanueva (Brookhaven National Laboratory (US))

HSF Workshop 2025 - HOWTO train.pdf

WLCG: Operations

Conveners: Julia Andreeva (CERN), Maarten Litmaath (CERN), Panos Paparrigopoulos (CERN)

Live Notes

Live Notes for WLCG Workshop

48 Introduction to the OPS session

Speaker: Julia Andreeva (CERN)

49 AUDITOR. First results of the assessment by the WLCG sites

AUDITOR (Accounting Data Handling Toolbox for Opportunistic Resources) is a flexible and extensible accounting system designed to support a wide range of use cases and infrastructures. Its integration with APEL enables it to function as a generic component within the WLCG accounting infrastructure, tracking the usage of various types of site computing resources. Several WLCG sites have evaluated AUDITOR, and the outcomes of these assessments will be reviewed and discussed.

Speakers: Alessandro Pascolini (Universita e INFN, Bologna (IT)), Alexander Raphael Kleinemuhl (Bergische Universitaet Wuppertal (DE)), Maria Alandes Pradillo (CERN), Max Fischer (Karlsruhe Institute of Technology), Michael Boehler (University of Freiburg (DE)), Michael Boehler (Deutsches Elektronen-Synchrotron (DE)), Thomas Hartmann (Deutsches Elektronen-Synchrotron (DE))

AUDITORintro.pdf

15:50 Coffee break

50 Accounting of jobs submitted with tokens and changes required in the WLCG accounting infrastructure.

Speaker: Mr Tom Dack

TDack-WLCGWShop-May25-TokenAccounting.pdf

TDack-WLCGWShop-May25-TokenAccounting.pptx

51 GGUS: past, present, future

Speakers: Aliaksei Hrynevich (Karlsruher Institut für Technologie), Aliaksei Hrynevich (Karlsruhe Institute of Technology (KIT)), Guenter Grein, Pavel Weber

20250507-ah-ggus-update.pdf

GGUS_PPF.pdf

52 Job Allocation and Handling, status report from the WG

Speaker: Antonio Perez-Calero Yzquierdo (Centro de Investigaciones Energéticas Medioambientales y Tecnológicas)

Slides

Slides

53 Security training opportunities

Speaker: David Crooks

CERNSchool_Summary.pdf

Thursday 8 May

08:30 Welcome coffee

Plenary: Environmental Sustainability

Conveners: Caterina Doglioni (The University of Manchester (GB)), David Britton (University of Glasgow (GB))

54 Introduction

Talk to set the scene and summarise the actions from the WLCG environmental sustainability workshop in December 2024: https://indico.cern.ch/event/1450885/timetable/

Speakers: Caterina Doglioni (The University of Manchester (GB)), David Britton (University of Glasgow (GB))

250508_ENV-Plenary-Intro.pptx.pdf

55 Power Accounting in Heterogeneous Compute Clusters

Energy efficiency is a critical concern for WLCG operations. We present a proof-of-concept for dynamic power accounting in our heterogeneous compute clusters at ScotGrid Glasgow. Our approach leverages real-time metrics from Prometheus to attribute energy consumption to individual Virtual Organizations (VOs) based on actual core usage. By integrating hardware-specific power efficiency data, derived from static measurements across different node generations, we compute per-core power usage while accounting for architectural differences.
Our methodology distinguishes between active power (consumed by running jobs) and infrastructure overhead (idle power and other services), the latter is allocated to the hosting institute. This granular, data-driven model not only provides transparent energy allocation but also encourages system administrators to optimize resource utilization and improve overall Power Usage Effectiveness (PUE).
Our work lays the foundation for integrating energy accounting into existing monitoring infrastructures and provides insights into sustainable cluster operations.

Speaker: Emanuele Simili

PoWaC_WLCG_eSimili_final.pdf

PoWaC_WLCG_eSimili_final.pptx

56 Enhancing Job Monitoring with Power Consumption Metrics

To support the sustainability of WLCG compute infrastructure, we propose a strategy to extend the current job monitoring system to include energy consumption data. Currently, WLCG monitoring systems primarily focus on traditional job metrics such as CPU time, memory usage, runtime, and failure rates.
However, they do not capture job-level power consumption, as this data is typically managed by fabric-level monitoring systems and is not directly accessible within jobs.

Our proposal is to bridge this gap by including node-level power measurements within the job data reports.
We have successfully demonstrated the feasibility of this idea with a prototype approach that uses standard WLCG grid jobs submitted to a set of pilot sites (DESY, AGLT, Glasgow).
Although this approach is valid for any kind of job payload, we have leveraged the HEPBenchmark Suite as payload, which organically captures both the performance of the node in terms of HS23 and a set of utilization metrics, including CPU load, memory usage, frequency, and power consumption.
This setup enables correlation between performance and energy efficiency metrics. It provides a more comprehensive view of job efficiency, revealing opportunities for optimization.
This is just the start of an R&D process that would need the involvement of the whole WLCG community to implement that strategy.

Speakers: Domenico Giordano (CERN), Natalia Diana Szczepanek (CERN)

WLCG_Workshop-Enhancing_Job_Monitoring_with_Power_Consumption-20250508.pdf

57 Energy saving measures during peak summer at DESY

This contribution will detail initial plans for reducing peak day loads at the DESY computing center during the summer.

Speaker: Thomas Hartmann (Deutsches Elektronen-Synchrotron (DE))

DESY_EnergySavings.pdf

58 GreenDIGIT: updates from the WLCG Environmental Sustainability Workshop

GreenDIGIT (https://greendigit-project.eu/) is a TECH-01-01 Horizon Europe project that started in March 2024 to pursue environmental sustainability within digital services and service ecosystems that research infrastructures (RIs) rely on. GreenDIGIT brings together institutes from 4 digital RIs: EGI, SLICES, EBRAINS, and SoBigData to address the pressing need for sustainable practices in digital service provisioning.

Central to GreenDIGIT's mission is the identification of good practices in lemphasized textow-impact computing, which involves evaluating the broader computing landscape and identifying opportunities for improvements across various stakeholder groups both within, and beyond the RIs represented in the project consortium. The project will establish reference architectures and design principles that facilitate environmental impact considerations throughout the entire RI lifecycle, ensuring that sustainability is embedded within the entire design-implementation-operation-termination phases of RIs at the level of nodes, services and components.

Moreover, GreenDIGIT will develop and validate innovative technologies and methodologies that empower digital service providers to reduce energy consumption and/or overall operational environmental impact. By supplying technical tools for both providers and researchers, the project promotes the design and execution of environmentally conscious digital applications, aligning with principles of Open Science and FAIR data management.

Through education and support initiatives GreenDIGIT will foster a culture of sustainability among researchers and service providers, equipping them with best practices for lifecycle management and operation. By mapping the landscape of environmentally friendly computing, and by offering policy and technical recommendations, the project not only enhances the sustainability of research infrastructures but also contributes to the broader goal of mitigating climate change.
The first tangible outcome of the project is a landscape analysis that was conducted within the 4 participating RIs, and within other RIs that operate significant digital infrastructures. The presentation will share the first findings from this landscape report, which included responses from 15 EGI sites, many being present in WLCG too.

In the second phase of the project EGI members will extend the EGI-WLCG service configuration database (GOCDB) with environmental metrics to fuel “green workload optimisation strategies” in HTC and Cloud infrastructures. Based on the metrics the DIRAC workload manager (CNRS), the AI4OS AI/ML framework (CSIC), the Terraform DevOps tool (SZTAKI) and a Data Center Energy scheduler (CESNET) will be extended to optimise job/VM/task execution according to green strategies.

In summary, the GreenDIGIT project is a transformative initiative that champions environmental sustainability in digital research services, offering various outcomes and collaboration opportunities to the WLCG community.

This contribution will present updates since the last presentation at the WLCG Environmental Sustainability Workshop in December, focusing on (a) Framework for managing the full digital RI lifecycle from the environmental perspective (b) Software tools for power usage efficiency

Speaker: Gergely Sipos

GreenDIGIT update to WLCG-HSF workshop May 2025.pdf

GreenDIGIT update to WLCG-HSF workshop May 2025.pptx

59 Discussion on power accounting benchmarks part 1: sites perspective

10:43 Coffee break

60 Green software in HEP: benchmarks and studies on MC generators

In this talk, we will describe the studies undertaken at the University of Manchester to estimate and improve the energy efficiency of computing hardware and software used by students and researchers.

The goal of these studies is to build an understanding of the environmental impact of paticle physics research focusing on two fronts:
1) the carbon cost of the hardware uses for high power computing hardware and the local computing cluster
2) the energy efficiency of data analysis software and machine learning models in “big data”-related scientific fields including as high-energy particle physics.

The focus of this contribution will be the energy efficiency of scientific software algorithms and MC generation packages, taking Herwig, ML data compression and top tagging algorithms as examples. We will discuss different tools and benchmarks and review their methodologies.

We will then describe our plans towards a lifecycle analysis for computing hardware, and work undergoing to estimate the power consumption of our local cluster more precisely.

Speakers: Luis Villar (University of Manchester), Tobias Fitschen (The University of Manchester (GB))

green_software_in_hep_wlcg_20250508.pdf

61 Environmental impact, carbon and sustainability of computing in the ATLAS experiment

In this contribution, we will describe the efforts within the ATLAS experiment to evaluate and mitigate various aspects of the environmental impact of ATLAS computing sites, such as building awareness in the experiment community, adjusting aspects of the computing policy, and modifications of data center configurations, either in ways that take advantage of particular features of ATLAS work or in generic ways that reduce the environmental impact of the computing.

Speaker: Rodney Walker (Ludwig Maximilians Universitat (DE))

SustainATLAS(1).pdf

62 Environmental impact of computing in LHCb

This contribution will present the activities in LHCb online and offline towards environmentally sustainable computing.

Speakers: Francesco Sborzacchi (CERN), Henryk Giemza (National Centre for Nuclear Research (PL)), Henryk Giemza (National Centre for Nuclear Research (PL))

Environmental impact of computing in LHCb.pdf

Environmental impact of offline computing in LHCb.pdf

63 Discussion on power accounting and beyond part 2: inputs from sites, users and experimental collaborations

12:30 Lunch

HSF: BOF (Birds Of a Feather)

Live slides

15:30 Coffee break

WLCG: DOMA - Working Groups and Data Challenges

Conveners: Johannes Elmsheuser (Brookhaven National Laboratory (US)), Katy Ellis (Science and Technology Facilities Council STFC (GB))

Live Notes

Live Notes for WLCG Workshop

64 Introduction and Status of DOMA

Speakers: Katy Ellis (Science and Technology Facilities Council STFC (GB)), Johannes Elmsheuser (Brookhaven National Laboratory (US))

20250508 WLCG DOMA introduction.pdf

65 Rucio in DOMA

Speaker: Martin Barisits (CERN)

Rucio in DOMA.pdf

66 FTS evolution towards DC27

Speakers: Mihai Patrascoiu (CERN), Steven Murray (CERN)

WLCG_HSF_Workshop2025_FTS4.pdf

15:15 Coffee break

67 Status of Monitoring of DOMA components

Speaker: Borja Garrido Bear (CERN)

2025-05-08-WLCG-Workshop-DomaMonitoring.pdf

68 Status of DOMA BDT activity

Speakers: Mihai Patrascoiu (CERN), Petr Vokac (Czech Technical University in Prague (CZ))

WLCG_HSF_Workshop2025_DOMA_BDT_Plans.pdf

69 Mini data challenges

Speakers: Johannes Elmsheuser (Brookhaven National Laboratory (US)), Katy Ellis (Science and Technology Facilities Council STFC (GB))

c_080525.pdf

WLCG: Collaboration Board - by invitation only

Live Notes

Live Notes for WLCG Workshop

70 Social Dinner

in La Mère Catherine

Social Dinner - instructions.pdf

Friday 9 May

08:30 Welcome coffee

Plenary: Closing

71 Computing Challenges for the Einstein Telescope

Speaker: Paul James Laycock (Universite de Geneve (CH))

ET-WLCG:HSF-Laycock.pdf

72 Recap and next steps - DOMA and WLCG Ops

Speakers: Katy Ellis (Science and Technology Facilities Council STFC (GB)), Panos Paparrigopoulos (CERN)

wlcg_ops_doma.pdf

73 Recap and next steps - WLCG/HSF Sustainability

Speakers: Caterina Doglioni (The University of Manchester (GB)), David Britton (University of Glasgow (GB))

250509_ENV-Plenary-Summary.pptx-2.pdf

10:20 Coffee break

74 Recap and next steps - HSF

Speaker: Graeme A Stewart (CERN)

WLCG_HSF 2025 - HSF summary-2.pdf

75 Recap and next steps - WLCG Technical Coordination

250509 - WLCG Technical Coordination - Closing Plenary.pdf

76 Recap and next steps - Analysis at scale

Speakers: Alessandra Forti (The University of Manchester (GB)), Dr Nicole Skidmore (University of Warwick)

20250509_WLCGHSF_AnalysisInfra.pdf

77 Some final words ...

WLCG-Workshop-2025-Thnaks.pdf

WLCG-Workshop-2025-Thnaks.pptx

12:00 Lunch

Be sure to say that you'll attend the lunch during the registration