BiLD-Dev

→ Europe/Zurich
2/R-014 (CERN)

2/R-014

CERN

10
Show room on map
Federico Stagni (CERN)
Description

Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

Zoom: BiLD
https://cern.zoom.us/j/62504856418?pwd=TU1kb01SOFFpSDBJeWVBdU9qemVXQT09

Meeting ID: 62504856418
Passcode: 12345678
 

Zoom Meeting ID
62504856418
Host
Federico Stagni
Useful links
Join via phone
Zoom URL
 

BiLD – 28/11/2024

At CERN: Federico, André, Christophe, Alexandre, Christopher, Ryun
On Zoom: Daniela, Simon, Hideki, Andrei, Alexey, Xiaomei, Janusz, Igor, Jorge
Apologies:


Follow-up from previous meetings

  • Last BiLD was November 14th
  • Last DIRAC certification hackathon on November 21st

DIRAC communities roundtable

LHCb:

Federico+Alexandre+Christopher+Vladimir

ILC/Calice/FCC

André

  • NTR

EGI

Andrei

  • Now submitting pilots with CheckIn Token (thanks to Simon), “disguised” to have the WLCG profile (WLCG claim). This needed a hotfix on the CheckIn server
    • A single client is used for all VOs, via a CheckIn plugin. This is an agreed solution done together via HTCondor. No work for ARC yet. 2 ways:
      • Dozens of site might have to be properly configured for each VO, with a single client
      • Alternatively just setup a client/VO in CheckIn (this is what is done for IAM). This seems to be the preferred solution
  • fromPreviousMeeting
    • Setting up the diracx test system with K3S in parallel with DIRAC 9.0. Struggling with setting up the basic setup (cert-manager, DEX, …)

Belle2

Hideki

  • Started to use apptainer, still using own wrapper

NICA

Igor

  • DB12

IHEP

Xiaomei

  • Delays waiting for Alma9

GridPP:

Daniela, Simon, Janusz

  • No change in production, but we would like to discuss the state tokens in ARC. I’ve added the relevant git issue in the issues section.

Topics from GitHub/Discussions

only un-answered DIRAC and DiracX topics with discussion updates:


DIRAC releases

  • v8.0.59
    • FrameworkSystem
      CHANGE: (#7895) Rename TokenManager service classes to follow standard convention for tornado and diset handlers
      NEW: (#7888) The DISET version of the TokenManager service
    • TransformationSystem
      CHANGE: (#7874) the TransformationCleaningAgent forces jobs to KILLED
    • WorkloadManagementSystem
      CHANGE: (#7891) added ulimit -n 1048575 to pilotwrapper content
      NEW: (#7866) for parametric jobs, added the possibility to bulk insert records in JobLoggingDB
      CHANGE: (#7886) Use plain proxy for the pilot bundle

DIRAC projects

DIRAC:

Issues by milestone:

Other issues:

PRs discussed:

  • NTR

WebApp:

  • NTR

Pilot:

  • from previous meeting Janusz some doc to write

DIRACOS:

Documentation:

  • NTR

OAuth2:

  • NTR

management

diraccfg

  • NTR

DB12

Rucio

  • NTR

Tests

  • NTR

DiracX:

Issues

  • solved a few issues

PRs discussed:

DiracX-charts:

DiracX-web:

  • fromPreviousMeeting feat: extension management
  • fromPreviousMeeting
    • Alexandre
      • Improvements to JobMonitoring app
      • Added the user’s details at login
      • Some tests for the extension needs to be added

Release planning, tests and certification

  • Certification machines

    • for next time Federico will allow a LegacyAdaptor for JobMonitoring (it was there in the past, why not anymore?)
      • PR in DIRAC
  • Next hackathon(s)

    • next week

Next appointments

AOB

  • Projects for ISIMA students
    • LHCb specific (LHCb extension, also for the Web)
    • Pilot

LHCbDIRAC

  • BKK:
    • less on :fire:
      • but denormalisation really improves the performances, “works beautifully”
        • a column was added MR created, (hot)fixed on some machine (for comparisons)
    • some tasks coming for Alexey
    • having a chat with CERN/IT for DBA help
      • repartition to hash of the production ID (hash partition type is a thing in Oracle)
        • this should be done by Kate (it doubles the size…)
    • Alexey Complete check of Luminosity started for Collision24
      • looks that earlier runs (around 1000) will need to be fixed
  • from previous meeting
    • Ryun possibility of running on a subset of a BkQuery for prescaling
      • “Merged”
    • Ryun’s DAG graphs: we can run “DAGs” in productions (sequentially)
      • CWL, one day
 
There are minutes attached to this event. Show them.
    • 10:00 → 10:10
      Items from Previous BiLD-Dev 10m
    • 10:10 → 10:20
      DIRAC Communities roundtable 10m
    • 10:20 → 10:30
      DIRAC releases 10m
    • 10:30 → 10:55
      DIRAC projects 25m
      • DIRAC
      • WebApp
      • Pilot
      • DIRACOS2
      • VMDIRAC
      • Documentation
      • OAuth2
      • DiracX
      • other externals (include Rucio)
    • 10:55 → 11:00
      Release planning, tests and certification 5m
    • 11:00 → 11:15
      Weekly development(s) focus 15m
    • 11:15 → 11:25
      AOB
      Convener: Federico Stagni (CERN)
    • 11:25 → 11:40
      LHCbDIRAC 15m