Focus on:  Hide Contributions
Login

BiLD-Dev

→ Europe/Zurich
2/R-014 (CERN)

2/R-014

CERN

10
Show room on map
Federico Stagni (CERN)
Description

Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

Zoom: BiLD
https://cern.zoom.us/j/62504856418?pwd=TU1kb01SOFFpSDBJeWVBdU9qemVXQT09

Meeting ID: 62504856418
Passcode: 12345678
 

Live notes
BiLD
Zoom Meeting ID
62504856418
Host
Federico Stagni
Useful links
Join via phone
Zoom URL
Hide
 

BiLD – 23/10/2025

At CERN: Federico, Christopher, Ryun, Alexandre
On Zoom: Ueda, Igor, Daniela, Janusz, Hideki, Alexei, Natthan, Andrei, Mazen, Alexei, Jorge
Apologies: Andrè

Previous meetings

  • Last BiLD was 2 weeks ago

DIRAC communities roundtable

LHCb:

Federico+Christopher+Alexandre+Ryun

  • Issues with CS becoming unavailable have been solved (for the moment).
  • Will update to last versions next week (preparing the updates now)

Belle2

Hideki, Ueda

  • Found some stomp related issues, will check if already signaled, if not will create a new one
  • Some old sites still using python 2 (still using EL7)
    • PilotWrapper should first look for py3

CTA:

Natthan

  • NTR
  • Working on CWL

GridPP:

Daniela, Simon, Janusz

  • No news in production – still on v8.0.74
  • v9.0.1 passed the first very basic test: no DiracX, no S3 and one sucessful job at Imperial
  • Fixes went into v9.0.2 and Daniela can confirm this still works.

EGI

Andrei

  • Smooth in production, 8.0.75
  • Created GreenDIRAC extension for keeping related developments: GreenReportingAgent, energy consumption by jobs tool (Mazen)
  • Got functional D9/Dx0.0.1 certification installation (Bertrand):
    • DIRAC9 host + 2 hosts k3s cluster for DiracX + S3/minIO
      • Chris+Federico should not run on 2. Better 1 or 3
    • Opensearch with certificate authentication
      • will contribute to DiracX for this
    • IAM dev IdP, failed with dteam IAM, Check-In in progress

JINR:

Igor

  • NTR
  • Working on consistency check between DIRAC FC and EOS storage. First result for BM@N:
EOS records (files+dirs):  1340323
DIRAC records (files+dirs):  1340280

Files: DIRAC + / EOS - :  50
Files: DIRAC - / EOS + :  64

Dirs: DIRAC + / EOS - :  0
Dirs: DIRAC - / EOS + :  29

Topics from GitHub discussions and bots

  • only un-answered DIRAC and DiracX topics with discussion updates:
    • NTR

Releases

DIRAC

  • v8.0.76
    • Nothing new since last meeting
  • v9.0.2
    • “just fixes” #worksforgridpp
  • v9.0.3
    • DiracX
      • NEW: (#8347) Depend on released versions of DiracX
      • NEW: (#8347) Depend on diracx-cli to ease management of DiracX CS conversion
    • FrameworkSystem
      • CHANGE: (#8324) Remove Registry/group option VOMSVO (simply use “VO”)
  • v9.0.4
    • because of network glitch

Issues (still there?):

diracx

  • actually, v0.0.2 also created
  • also diracx-web tagged

Release planning, tests and certification

  • reminders:

    • for DIRAC there’s still only integration branch (~same for WebApp)
      • we’ll keep using the integration branch for now

  • Upgrade to v9+0.0.1

    • the wiki has been again updated several times in the last 2 weeks, after remarks from GridPP.

  • Certification machines

    • Federico not updated (no time). I will try in the next days so that we have a hackathon next week

  • Next hackathon(s)

    • Federico will call one once the cert machines are updated

DIRAC projects

DIRAC:

Issues by milestone:

Other issues:

  • Get infos from CRIC
    • any volunteer?
  • Make the PushJobAgent compatible with more CEs (HTCondor? SSH?)
    *
  • from previous meeting Proposal for input data resolution format
  • from previous meeting Replacement for BDII2CSAgent #8194
    • “nice” discussion :gun:
    • 17th July
      • recent answers in the GGUS ticket above from AP seems to point in the right direction
      • nevertheless, Federico is trying to grab info on if we can do a “CEs” crawler ourselves. ARC CEs seem to provide the necessary information, issues are from HTCondorCEs
    • This has now been discussed in the GridPP project management board. Conclusion was unfortunately “input from GOCDB team needed”
    • 09 Oct 2025 GridPP ops team asked UK sites to implement Alessandro’s suggestion. The following issues were observed:

      • It’s not documented (beyond a soon-to-be-archived broadcast)

      • Free form encourages typos and misremembered VO names (vo.na62.gridpp.ac.uk vs na62.vo.gridpp.ac.uk) – this would not happen with predefined scopes

      • RAL as the Tier 1 hit the length limit for extension as it supports too many VOs

      • Sigh.

        • Last message from Federico:

        For those of you who are running a HTCondor CE, would you mind investigating if the content of auth-map + accounting-map files could be made public? Maybe we are lucky and it’s a trivial thing to be done.

        • Daniela This has gone to the HTCondor developers via RAL, but so far no answer.

PRs discussed:

WebApp:

  • not Created v6.0.0 version – issue with pipeline, will check later on

Pilot:

  • PR for removing Python2 support merged in devel branch
    • will be merged into master after a DIRAC(X) hackathon
    • if you really want to keep py2 support, there’a tag
    • At some point can also merge the equivalent DIRAC PR which will effectively also render the p2_eol tag useless
  • from previous meeting Pilot migration
    • diracx pilot route
  • from previous meeting PR feat: Adding JWT support alongside X509 auth
    • the new Pilot command can call directly the route, no need to use the CLI
    • the integration tests for this will be set up once diracx is updated with the connected diracx PR

DIRACOS:

  • NTR

Documentation:

management

  • from previous meeting new /cvmfs/dirac.cern.ch repository created – CERN ticket
    • action on cburr to populate it (using LHCb “machinery”)

DB12

  • Federico “I asked Igor if he wanted to become one if not the main maintainer”
  • We should agree on a strategy on how to do things here, as PRs can’t just be merged:
    • there are reports created that depend from it, merging/releasing on a random Tuesday is not the way to go
    • can we have parallel benchmarks? not clear actually if that’s doable
    • Federico maybe create a “2026” release?
      • we should see if there would be time for that

Rucio

Tests

  • NTR

DiracX:

  • dependabot alert for web

    • N interesting TR

  • Releases are created thanks to release-please tool

    • diracx-web was using this tool already
    • cburr maybe what will NOT be used at the end, so do not look into it yet

Issues

  • There are several “Good first issues” looking for volunteers

PRs discussed:

CWL prototype

DiracX-charts:

DiracX-web:

  • PRs needing merging?

Next appointments

AOB

  • It’s again CHEP abstract submission time, deadline 19th December

    • Dirac(X) “state of affairs” abstract? Other suggestions?
    • who plans to go?

  • ISIMA forum 20th-21st November (students will be LHCb-hosted). Time to write down project proposals – ideas?

    • do you want to be a non-official supervisor?

  • from previous meeting DIRAC as an “HSF affiliated project” : https://hepsoftwarefoundation.org/projects/affiliated.html

    • 23 Oct 2025 No further updates

LHCbDIRAC

  • Some MRs created/merged/hotfixed by Ryun
  • The CS in lhcbdiracx has not been updated lately because of new fields added which do not pass the validation
    • so no new users in the last 10 days
    • protection from that is in the works (issue in DIRAC attached to Natthan)
  • The CS overloading is still on-the-edge, needs Pilots to respect the PreferredURL regex
    • propagate to pilot.json and then pilot.cfg and then OK (?)
  • Several MRs in the system, reminders to update the existing ones and check what’s actually ready for merge
  • Bookkeeping
  • LHCb abstracts for CHEP go in https://codimd.web.cern.ch/4mOg3RgsT1eVTnb4KT3Tuw?edit
 
There are minutes attached to this event. Show them.
    • 10:00 → 10:10
      Items from Previous BiLD-Dev 10m
    • 10:10 → 10:20
      DIRAC Communities roundtable 10m
    • 10:20 → 10:30
      DIRAC releases 10m
    • 10:30 → 10:55
      DIRAC projects 25m
      • DIRAC
      • WebApp
      • Pilot
      • DIRACOS2
      • VMDIRAC
      • Documentation
      • OAuth2
      • DiracX
      • other externals (include Rucio)
    • 10:55 → 11:00
      Release planning, tests and certification 5m
    • 11:00 → 11:15
      Weekly development(s) focus 15m
    • 11:15 → 11:25
      AOB
      Convener: Federico Stagni (CERN)
    • 11:25 → 11:40
      LHCbDIRAC 15m
Powered by Indico v3.3.9-pre