WLCG Open Technical Forum (OTF) #5

Name: WLCG Open Technical Forum (OTF) #5
Start: 2025-06-24T13:30:00+02:00
End: 2025-06-25T17:30:00+02:00
Location: CERN

24 Jun 2025, 13:30 → 25 Jun 2025, 17:30 Europe/Zurich

31/3-004 - IT Amphitheatre (CERN)

31/3-004 - IT Amphitheatre

CERN

105

Show room on map

Alessandro Di Girolamo (CERN), James Letts (Univ. of California San Diego (US))

Description

Welcome to the WLCG Open Technical Forum (OTF).

The WLCG Technical Coordination Board (TCB) is responsible for the technical evolution of WLCG services in line with the needs of the experiments and the capabilities of the infrastructure providers. The TCB defines a multi-year roadmap for such evolution and is responsible for its implementation. The TCB achieves these goals with a bottom-up approach through an Open Technical Forum (OTF) which welcomes the participation of all contributors to the technical evolution in the WLCG community.

Organizational matters:

Please register only if you plan to attend in person.
If you require a visitor pass, please contact lcg.office AT cern.ch at least 48h before your travel.

Registration

Participants

Alessandro de salvo
Andreu Pacheco Pages
Arne Wiebalck
Berk Balci
Daniele Spiga
Diego Ciangottini
Fabio Luchetti
Louis Regnier
Mario Lassnig
Martin Gasthuber
Michele Delli Veneri
Mihai Patrascoiu
Panos Paparrigopoulos
Tobias Klann
Wojciech Wislicki
+17

63997284703

James Letts

Join via phone

Tuesday 24 June
- Tue 24 Jun
- Wed 25 Jun
- Resource Provisioning with k8s
  (Coffee will be available starting from 13:30)
  
  Resource Provisioning in WLCG - Problem Statement
  The WLCG community has relied for a long time on traditional batch systems at computing centers to provision resources for data processing and analysis. However, the increasing complexity and diversity of workloads for HL-LHC - including AI/ML training, interactive analysis, and on the one side, and the popularity of heterogeneous providers (such as HPC and Cloud) providing sizable amount of and specialized/heterogeneous hardware (e.g., GPUs) on the other side- are pushing the boundaries of what these systems can efficiently support. All this clearly poses challenges in an effective integration but might open the doors to new patterns of data access/processing.
  Emerging technologies such as Kubernetes (k8s) offer new models for dynamic and scalable resource provisioning and, although k8s based platforms are particularly suitable to expose and manage applications (services-oriented), nowadays lightweight job scheduling systems (such as kueue) are gaining traction.
  The problem we face is how to evolve our provisioning models to support this broader ecosystem of resources, to enable new workload and processing patterns, while maintaining interoperability, efficiency, and sustainability (i.e. reducing the operational costs.) across WLCG. Some of the points we would like to understand:
  - What are the concrete use cases driving this evolution, what role can we foresee for k8s native scheduling systems?
  - What are the technical and organizational barriers to adoption?
  - What role can k8s have in enhancing the ML/AI development within communities computing systems?
  - How can we bridge traditional batch systems with k8s-based or hybrid models? What are the opportunities for systems/applications to scale-out?
  - What role can community-developed solutions (e.g., interLink, SONIC) play?
  This session aims to frame these questions, share early implementations, and identify common challenges and opportunities for collaboration
  Live Notes (Tuesday)
  - 1
    
    Introduction for OTF#5 and Problem Statement for the Session
    
    Speakers: Alessandro Di Girolamo (CERN), James Letts (Univ. of California San Diego (US))
    
    250624 - WLCG Open Technical Forum #5 Introduction.pdf
  - 2
    
    The state of the Kubernetes/Cloud Native scientific computing ecosystem
    
    Speaker: Ricardo Rocha (CERN)
    
    WLCG OTF_ Cloud Native Scientific Computing.pdf
  - 3
    
    Experience with interLink based Offloading to Extend k8s Clusters
    
    Speakers: Daniele Spiga (Universita e INFN, Perugia (IT)), Diego Ciangottini (INFN, Perugia (IT))
    
    interLink_at _OTF.pdf
  - 4
    
    Kueue overview and upcoming enhancements
    
    Speakers: Raulian-Ionut Chiorescu, Ricardo Rocha (CERN)
    
    WLCG OTF_ Kueue Overview and Upcoming Enhancements.pdf
  - 16:00
    
    coffee/tea break
  - 5
    
    Deployment of SuperSONIC with k8s
    
    Speaker: Dmitry Kondratyev (Purdue University (US))
    
    SuperSONIC - WLCG OTF 2025_06_24.pdf
  - 6
    
    K8S for workload provisioning in ATLAS
    
    Speaker: Fernando Harald Barreiro Megino (University of Texas at Arlington)
    
    WLCG OTF - ATLAS Resource Provisioning with k8s-1.pdf
  - 7
    
    The Next Generation Triggers Platform
    
    Speaker: Raulian-Ionut Chiorescu
    
    The Next Generation Triggers Platform - WLCG Open Technical Forum #5.pdf
Wednesday 25 June
- Tue 24 Jun
- Wed 25 Jun
- FTS Evolution toward Run4
  
  (Coffee will be available starting from 13:30)
  
  Live Notes (Wednesday)
  - 8
    
    Introduction and problem statement
    
    Speakers: Alessandro Di Girolamo (CERN), James Letts (Univ. of California San Diego (US))
  - 9
    
    FTS Evolution - draft of the plan
    
    Speakers: Mihai Patrascoiu (CERN), Steven Murray (CERN)
    
    fts_otf_june_2025.pdf
  - 10
    
    FTS and LHCb
    
    Speaker: Christophe Haen (CERN)
    
    OTF_FTS4LHCb.pdf
  - 11
    
    FTS and CMS
    
    Speaker: Panos Paparrigopoulos (CERN)
    
    CMS input for FTS4 - OTF 25_6_2025.pdf
  - 12
    
    FTS and ATLAS
    
    Speaker: Alessandra Forti (The University of Manchester (GB))
    
    20250222_OTF_ATLAS_FTS.pdf
  - 15:15
    
    Coffee and tea
  - 13
    
    discussion