BiLD-Dev

Thursday 23 Nov 2023, 10:00 → 12:00 Europe/Zurich

2/R-014 (CERN)

Federico Stagni (CERN)

Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

Zoom: BiLD
https://cern.zoom.us/j/62504856418?pwd=TU1kb01SOFFpSDBJeWVBdU9qemVXQT09

Meeting ID: 62504856418
Passcode: 12345678
 

working notes

BiLD (Bi-weekly DIRAC Development meeting) – 23/11/2023

At CERN: Andrè, Alexandre
On Zoom: Federico, Janusz, Daniela, Simon, Alexey, Michel
Apologies: Christophe, Christopher, Andrei

Follow-up from previous meetings

• Last BiLD on Nov 2nd
  • Trying to catch all updates below
• Last DIRAC certification hackathon 2 weeks ago. Basically, did nothing but discovering that we could not really run without diracx fixes
  • https://trello.com/b/INEixc2q/v900a2
• BildX on Nov 16th
  • note: https://demo.hedgedoc.org/GLU5QsQXRsCZ_792cQkPRw
  • mostly reported about namespaces packaging

DIRAC communities roundtable

LHCb:

 Federico+Alexandre+Alexey

• Running on latest v8 patch – NTR

Belle2

 Michel

• Attempting to install DIRAC from CVMFS from Pilot
  • version of the Pilot still outdated
  • will try using the latest pilot
• Discussion of how to improve monitoring of transformations
  • more generically, if there other issues

ILC/Calice/FCC

 Andre, Lorenzo

• Updated to 8.0.32
• No token provider for any VO yet, FCC promised for about January 2024

BES3/Juno

 Xiaomei

• NTR

GridPP:

 Simon, Janusz, Daniela

• Prod and pre-prod now on 8.0.31
• Token tested for HTCondor (at Imperial) and AREX (at RALPP) for gridpp VO using our own IAM server
• Trying to recruit more sites for testing and looking at starting to roll it out on prod server
• Limited enthusiasm from sites at the moment.
• We learned that CERN apparently did not foresee to provide IAM servers to all the VOs they provide voms servers for.

Topics from GitHub/Discussions

only un-answered topics with discussion updates:

• not much questions/updates lately

DIRAC releases

• v8r0
  • v8.0.32
    • DataManagementSystem
      • CHANGE: (#7296) default proxy lifetime for FTS is 36h and force the redelegation when 12h are left
    • WorkloadManagement
      • NEW: (#7266) SiteDirector - added preinstalledEnv and preinstalledEnvPrefix pilot options
• v9r0
  • Created v9.0.0a2

DIRAC projects

DIRAC:

Issues by milestone:

v8.0:

• 15+ open issues
  • usual reminder for closing/moving old ones

v9.0:

• 15+ open issues

Other issues:

• https://github.com/DIRACGrid/DIRAC/issues/7260
  •  Chris will take care

PRs discussed:

• Minor comments for some of them

WebApp:

• NTR

Pilot:

• Still, did not merge devel to master because of unavailability of stable DIRAC certification setup. Next steps:
  1. fix lbcertifdirac70 installation
  2. submit pilots, verify
  3. if OK, try in LHCbDIRAC certification system
  4. if OK, try in LHCbDIRAC production
  5. merge devel to master
     5.1. close master branch to contributions

DIRACOS:

• NTR

Documentation:

• Minor issue in one script

OAuth2:

• Multi-VO pilots submission: it is OK now, it seems

management

• from previous meeting 3 issues left, still valid?
• Always upload releases to CVMFS is again valid for clients
  • higher priority now. This should also be done for non-x86 versions.

diraccfg

• NTR

DB12

 Alexandre

•  Federico merged PR fixing the tests
•  Ewoud opened PR for py3.11 (in progress)
  • missing the Intel vs AMD
•  Federico Can we have DB12 run on ARM
  • Andrè : I access two “real” ARM machines through OpenStack that can be used for the tests
  • Federico: I will pass it to Ewoud

Rucio

• NTR

Tests

• NTR

Release planning, tests and certification

Certification machines

• lbcertifdirac70 machine:
  • NTR

Next hackathon(s)

• next week

AOB

Next hackathon: Nov 30th
Next BiLDX: Dec 7th
Next BiLD: Dec 14th (last DIRAC meeting of 2023)

DIRAC+X hackathon:

• https://indico.cern.ch/event/1343151/
• 23rd-24th Jan 2024
• CERN, “usual” room
• You need to register
• Anyone’s welcome to suggest specific topics
•  Federico attempts to upgrade to v9 pre-versions can be done

Next DIRAC Users’ workshop: originally planned for 27th-29th May 2024 (effectively 2 half and one full day) in Lyon https://indico.cern.ch/event/1341205, but issue with dates:

• https://newdle.cern.ch/newdle/rCSkJgHp/summary
• June 19th ==> seems OK

---

LHCbDIRAC

• v11.0: deploy board in https://trello.com/b/Ep0PAkbv/deploy-110
  • NTR
• Bookkeping:
  • few issues accumulating
  • Alexey looking into them

10:00 → 10:10 Items from Previous BiLD-Dev

10:10 → 10:20 DIRAC Communities roundtable

10:20 → 10:30 DIRAC releases

10:30 → 10:55 DIRAC projects

• DIRAC
• WebApp
• Pilot
• DIRACOS2
• VMDIRAC
• Documentation
• OAuth2
• DiracX
• other externals (include Rucio)

DIRAC certification

• Certification setups
• Cert task board teamplate
• Slack channel

10:55 → 11:00 Release planning, tests and certification

DIRAC PRs

11:00 → 11:15 Weekly development(s) focus

11:15 → 11:25 AOB

Convener: Federico Stagni (CERN)

11:25 → 11:40 LHCbDIRAC