BiLD-Dev

→ Europe/Zurich
2/R-014 (CERN)

2/R-014

CERN

10
Show room on map
Federico Stagni (CERN)
Description

Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

Zoom: BiLD
https://cern.zoom.us/j/62504856418?pwd=TU1kb01SOFFpSDBJeWVBdU9qemVXQT09

Meeting ID: 62504856418
Passcode: 12345678
 

Zoom Meeting ID
62504856418
Host
Federico Stagni
Useful links
Join via phone
Zoom URL
 

BiLD – 12/12/2024

At CERN: Christophe, Alexandre, Christopher, Ryun
On Zoom: Daniela, Simon, Hideki, Andrei (host), Xiaomei, Janusz, Jorge
Apologies: Federico, André


Follow-up from previous meetings

  • Last BiLD was November 28th
  • Last DIRAC certification hackathon on December 5th
  • Chris LHCb will likely deploy a final prerelease in production early next year (before the end of February). Then others can follow.

DIRAC communities roundtable

LHCb:

Alexandre+Christophe+Christopher+Vladimir

  • Running continuously 350K+ jobs concurrently, with latest v8 version.
  • Recent worrying issue: the main configuration file (/opt/dirac/etc/Prod.cfg) suddenly “disappears”.

ILC/Calice/FCC

André

  • NTR

EGI

Andrei

  • fromPreviousMeeting
    • Agreed with the Check-In managers:
      • Use a client per VO
      • Add wlcg.ver claim to pass token identification on HTCondorCE sites
    • This will allow to unblock the situation with pilot submission with tokens; clients are being set up and sites will receive corresponding instructions
  • fromPreviousMeeting
    • Setting up the diracx test system with K3S in parallel with DIRAC 9.0. It uses external MySQL and ES servers. Work in progress, the installation becomes functional, still more understanding/configuration needed (DEX, cert-manager).

Belle2

Hideki

  • Many sites migrating to EL9
  • Some sites are not compartible with the bundled proxy when using SSHCE and python3. Hideki will open an issue.

IHEP

Xiaomei

  • Migrating the DIRAC servers to Alma9.
  • Using tokens for job submission, all sites
  • All sites migrated to EL9, all HTCondorCE.

NICA

Igor

  • NTR

GridPP:

Daniela, Simon, Janusz

  • We upgraded the production server from 8.0.38 to 8.0.60. At least initially no problems were observered, but we are watching the server with interest.

Topics from GitHub/Discussions

only un-answered DIRAC and DiracX topics with discussion updates:

  • NTR

DIRAC releases

  • v8.0.60
    • Resources
      CHANGE: (#7913) Add option to include proxy on AREX token submission
    • WorkloadManagment
      CHANGE: (#7907) Better caching performance in the Matching Limiter

DIRAC projects

DIRAC:

Issues by milestone:

Other issues:

PRs discussed:

  • NTR

WebApp:

  • NTR

Pilot:

  • from previous meeting Janusz some doc to write

DIRACOS:

Documentation:

  • DIRAC is no more en-slaving processes.

OAuth2:

  • NTR

management

diraccfg

  • NTR

DB12

Rucio

  • Organization for WS well ongoing. Asked contributions to participants.

Tests

  • Updated versions of dependencies used in Integration tests

DiracX:

Issues
*

PRs discussed:

DiracX-charts:

DiracX-web:

  • fromPreviousMeeting feat: extension management
  • fromPreviousMeeting
    • Alexandre
      • Improvements to JobMonitoring app
      • Added the user’s details at login
      • Some tests for the extension needs to be added

Release planning, tests and certification

  • Certification machines

    • for next time Federico will allow a LegacyAdaptor for JobMonitoring. There is an old PR in DIRAC. Should anyway be tested before v9 is out
  • Next hackathon(s)

    • next Thursday (last of the year)

Next appointments

AOB

  • Projects for ISIMA students: took 3 students at the end:
    • Pilot (security model)
    • Matcher for DiracX (new)
    • LHCb specific (LHCb extension, also for the Web)

LHCbDIRAC

  • fromPreviousMeeting BKK:
    • denormalisation really improved the performances, “works beautifully”
    • some tasks coming for Alexey
    • having a chat with CERN/IT for DBA help
      • repartition to hash of the production ID (hash partition type is a thing in Oracle)
        • this should be done by Kate (it doubles the size…)
    • Alexey Complete check of Luminosity started for Collision24
      • looks that earlier runs (around 1000) will need to be fixed
  • from previous meeting
    • Ryun possibility of running on a subset of a BkQuery for prescaling
      • “Merged”
    • Ryun’s DAG graphs: we can run “DAGs” in productions (sequentially)
      • CWL, one day
 
There are minutes attached to this event. Show them.
    • 10:00 → 10:10
      Items from Previous BiLD-Dev 10m
    • 10:10 → 10:20
      DIRAC Communities roundtable 10m
    • 10:20 → 10:30
      DIRAC releases 10m
    • 10:30 → 10:55
      DIRAC projects 25m
      • DIRAC
      • WebApp
      • Pilot
      • DIRACOS2
      • VMDIRAC
      • Documentation
      • OAuth2
      • DiracX
      • other externals (include Rucio)
    • 10:55 → 11:00
      Release planning, tests and certification 5m
    • 11:00 → 11:15
      Weekly development(s) focus 15m
    • 11:15 → 11:25
      AOB
      Convener: Federico Stagni (CERN)
    • 11:25 → 11:40
      LHCbDIRAC 15m