BiLD-Dev

Thursday 6 Mar 2025, 10:00 → 12:00 Europe/Zurich

2/R-014 (CERN)

Federico Stagni (CERN)

Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

Zoom: BiLD
https://cern.zoom.us/j/62504856418?pwd=TU1kb01SOFFpSDBJeWVBdU9qemVXQT09

Meeting ID: 62504856418
Passcode: 12345678
 

Notes

 

 

BiLD – 06/03/2025

At CERN: Federico, André, Christophe, Christopher, Alexandre, Ryunosuke
On Zoom: Simon, Janusz, Hideki, Henryk, Alexey, Jorge, Vladimir, Xiaomei
Apologies:

---

Follow-up from previous meetings

• Last BiLD was Feb 25th
• Last DIRAC certification hackathon on Feb 13th
  • The one planned for last week was canceled

---

DIRAC communities roundtable

LHCb:

Federico+Alexandre+Christophe+Christopher+Vladimir

• NTR
• fromPreviousMeeting
  • Prepared a lhcbdiracx instance (with lhcbdiracx and lhcbdiracx-web), starting to run tests there
    • After going into production, we will release v9+0.1
  • Running a stress test (a “ping” from the pilots)

ILC/Calice/FCC

André

• NTR

Belle2

Hideki

• DB issues resolved (run optimize)

GridPP:

Simon, Janusz

• NTR

Juno

Xiaomei

• NTR

---

Topics from GitHub discussions and bots

• only un-answered DIRAC and DiracX topics with discussion updates:
  • NTR

---

DIRAC releases

• v8.0.70
  • added TTLCache for getProxyPrrovidersForDN
  • fixes for dirac-apptainer-exec for running within the pilot

---

DIRAC projects

DIRAC:

Issues by milestone:

• v8.0:
  *
• v9.0:
  *
• After v9.0:
  • adding here those issues that will be treated in the lifetime of v9

Other issues:

• Several issues open since long, some might be solved already. Please review those that you opened yourself

PRs discussed:

• [9.0] move default MySQL charset to utf8mb4
  • made this PR “ready” (was in draft for more that a year without changes…) as Federico started looking into it again
  • merging this PR will not imply work on anyone’s side
  • It is anyway suggested to update the character set of your DBs
• [9.0] use containerized certs creation
  • Big PR in terms of code changes, mostly because of fixes for “just wrong” way of testing (e.g. no clear separation between server and client)
  • Needs [8.0] integration test fixes (actually mounting volumes)
• [8.0] More fixes for dirac_apptainer_exec
  • ready for review
• [8.0] Add PreferredURLPattern for URL sorting
  • input from Belle2, which likes the idea of global setting

WebApp:

• from previous meeting One draft PR

Pilot:

• Federico added possibility to use dirac-apptainer-exec for running command in the pilot (mostly for dirac-platform). PR is there, but tests with dirac-apptainer-exec are not working, so “almost” empty PR
  • Can be merged as-is

DIRACOS:

• Release 2.51 : https://github.com/DIRACGrid/DIRACOS2/releases/tag/2.51
  • FIX: (#144) Remove setrlimit in XRootD
  • CHANGE: (#142) Upper constrain for davix
• The above sorts out issues when running at new (very) large RAL nodes, hopefully the next XRoot release will have a proper fix for that

Documentation:

• Janusz added pilot logging documentation

OAuth2:

• NTR

management

• Few updates for certificates-creation images

diraccfg

• NTR

DB12

• from previous meeting https://github.com/DIRACGrid/DIRAC/issues/7760#issuecomment-2482420604
  • Federico proposed to create “alternate” benchmark

Rucio

• [8.0] Implementation of findfilesbymetadata 's method into rucio file catalog client
  • merged but https://github.com/DIRACGrid/DIRAC/pull/8046/files#r1979054892
    • consensus is that it is not dangerous

Tests

• from previous meeting Federico Started adding Rucio to Dirac integration tests

---

DiracX:

• Road Map : https://github.com/chaen/diracx/blob/roadmap/docs/ROADMAP.MD

• dependabot alert

  • nothing that it is “solvable” by us

• Projects for ISIMA student:

  • Pilot (security model)
    • note
    • few of us met and discussed a more detailed plan, note updated to reflect the discussion

Issues
*

PRs discussed:

• Large PR from Alexandre: on adding a business logic layer
  • A new layer (diracx-logic) for domain-specific stuff.
  • Federico the other existing PRs will likely be affected, so merge “fast”
    • will be done today
• from previous meeting Federico thinks the reviews should be more prompt, and not only following on the shoulders of Chris&Chris
• fromPreviousMeeting OTel proof of concept PR: https://github.com/DIRACGrid/diracx/pull/379
  • This is a poc PR that is not yet merge-able. Christophe giving instructions to Jorge on how to proceed

DiracX-charts:

•  

DiracX-web:

•  

---

Release planning, tests and certification

• Certification machines

  • MySQL: Federico tried to update all character set to utf8mb4, discovered bug on dbod side

• Next hackathon(s)

  • in 2 weeks

Next appointments

• Meetings:

  • hackathon: in 2 weeks
  • BiLD: in 3 weeks

• WS/hackathons/conferences:

  • DiracX hackathon: 5 and 6 May - https://indico.cern.ch/event/1501369/
    • registrations open
  • Dirac Users’ Workshop: 17th-20th September 2205 - https://indico.cern.ch/e/duw11
    • registrations open, Xiaomei added few info for VISA

AOB

• DIRAC was invited to be an “HSF affiliated project” : https://hepsoftwarefoundation.org/projects/affiliated.html
  • Andrei, André, Federico met with Edoardo and Michel Jouvin for few clarifications. Andrei will call a consortium meeting

---

LHCbDIRAC

• LHCbDiracX
  • ISIMA for LHCb specific (LHCb extension, also for the Web): note
    • After a bit lengthy discussion we think that the student could create a brand new BookkeepingBrowser Web App in LHCbDiracX-Web. The thing do not (probably shouldn’t at all) mimic the existing Web App, rather it should be an opportunity for re-designing it completely. So, start with requirements and user stories.
  • certification setup: updates?
• Federico will update MySQL to 8.4.2 for the certification setup. I will follow up for the production databases
  • Update plan: https://codimd.web.cern.ch/dnfwITCRRTSvhopGDjlHSA?both
  • Federico will merge with existing note(s) to have only one

 

1 Items from Previous BiLD-Dev

2 DIRAC Communities roundtable

3 DIRAC releases

4 DIRAC projects

• DIRAC
• WebApp
• Pilot
• DIRACOS2
• VMDIRAC
• Documentation
• OAuth2
• DiracX
• other externals (include Rucio)

5 Release planning, tests and certification

6 Weekly development(s) focus

AOB

Convener: Federico Stagni (CERN)

7 LHCbDIRAC