BiLD-Dev
Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.
Zoom: BiLD
https://cern.zoom.us/j/62504856418?pwd=TU1kb01SOFFpSDBJeWVBdU9qemVXQT09
Meeting ID: 62504856418
Passcode: 12345678
BiLD – 06/02/2025
At CERN: Federico, André, Christophe, Alexandre, Christopher
On Zoom: Daniela, Simon, Hideki, Ueda, Natthan, Andrei, Jorge, Vladimir, Alexey, Cedric
Apologies:
Follow-up from previous meetings
- Last BiLD was December 12th
- Last DIRAC certification hackathon on December 5th
- We then had:
- DiracX hackathon: 14th-15th January 2025, CERN https://indico.cern.ch/event/1458873/
- Not only the usual faces! In fact, large-ish participation from CTAO developers.
- Summary of the immediate results in the minutes
- Dirac&Rucio mini-workshop and hackathon: 16th-17th January 2025, CERN https://indico.cern.ch/event/1443765/
- 45 registered participants, about 30 on site. Good participation, with some results coming from the hackathon part
- notes in https://codimd.web.cern.ch/L1Rfoz-JTJiyPqUJuHffWQ?view
- non-formal agreement is to repeat in about a year time
- DiracX hackathon: 14th-15th January 2025, CERN https://indico.cern.ch/event/1458873/
DIRAC communities roundtable
LHCb:
Alexandre+Christophe+Christopher+Vladimir
- Running continuously 250K+ jobs concurrently, with latest v8 version.
- Prepared a
lhcbdiracxinstance (withlhcbdiracxandlhcbdiracx-web), starting to run tests there- After going into production, we will release v9+0.1
- Running a stress test (a “ping” from the pilots)
- Accounting issues in using tokens for ARC6 CEs. Suggestion is to wait for ARC7 sites.
ILC/Calice/FCC
André
- NTR
EGI
Andrei
- Running smoothly
- fromPreviousMeeting
- Agreed with the Check-In managers:
- Use a client per VO
- Add
wlcg.verclaim to pass token identification on HTCondorCE sites
- Agreed with the Check-In managers:
- Instructions are sent to HTCondorCE sites to configure the SCITOKENS authentication for most popular DIRAC VOs
- Managed to run OpenSearch, small fix incoming with PR
- fromPreviousMeeting
- Setting up the diracx test system with K3S in parallel with DIRAC 9.0. It uses external MySQL and ES servers. Work in progress, the installation becomes functional, still more understanding/configuration needed (DEX, cert-manager).
- Authentication is set up for several VOs to demonstrate multi-IdP/Multi-VO case, works. Used Check-In-dev, wlcg.cloud.cnaf.infn.it, in the pipeline production Check-In, dteam-auth.cern.ch
- Set up Gitlab based DiracX configuration management (CS, values)
Belle2
Hideki
- fromPreviousMeeting Some sites are not compartible with the bundled proxy when using SSHCE and python3. Hideki will open an issue.
- Issue was opened, should be SOLVED
GridPP:
Daniela, Simon, Janusz
- Nothing to report.
CTAO
Natthan, Luisa
- Moved on the Diracv9 configuration
- Some issues:
- issue with dex IdP (can we run without it?)
- issue not related to diracx but currently problem with nginx controller "path type error with
/.well-known" - “Empty cartesian product” error in SiteDirector
Topics from GitHub/Discussions
only un-answered DIRAC and DiracX topics with discussion updates:
- NTR
DIRAC releases
- v8.0.6x
- several releases done in the last few weeks, mostly for solving operational issues
DIRAC projects
DIRAC:
Issues by milestone:
- v8.0:
- Several bug fixes and “minor” PRs
- v9.0:
- only 2 left here
- After v9.0:
- adding here those issues that will be treated in the lifetime of v9
- Several issues open since long, some might be solved already. Please review those that you opened yourself
PRs discussed:
- Old draft PR [8.0] feat: SingularityCE: looking for the platform-aware image in CVMFS
- It would be useful to at least run
dirac-platforminside the container
- It would be useful to at least run
WebApp:
- One draft PR
Pilot:
- from previous meeting Janusz some doc to write
DIRACOS:
- Few versions for updates
Documentation:
- Federico removed or reduced outdated documentation
OAuth2:
- NTR
management
- NTR
diraccfg
- NTR
DB12
- from previous meeting https://github.com/DIRACGrid/DIRAC/issues/7760#issuecomment-2482420604
- Federico proposed to create “alternate” benchmark
Rucio
Tests
- Federico Started adding Rucio to Dirac integration tests
DiracX:
-
Road Map : https://github.com/chaen/diracx/blob/roadmap/docs/ROADMAP.MD
-
In general, quite some activity going on. Lots of techical PRs.
Issues
- Several issues being opened and closed
PRs discussed:
- OTel proof of concept PR: https://github.com/DIRACGrid/diracx/pull/379
- This is a poc PR that is not yet merge-able. Christophe giving instructions to Jorge on how to proceed
DiracX-charts:
- fromPreviousMeeting MERGED feat(diracx-web): support npm workspaces
- Several improvements during the hackathon 2 weeks ago, but also more issues spotted
DiracX-web:
- Issues with the tool chosen for making releases - a new one will be needed
Release planning, tests and certification
-
Certification machines
- Rebooted lbcertidirac70
-
Next hackathon(s)
- next Thursday
Next appointments
-
Meetings:
- hackathon: next week
- BiLD: in 2 weeks
-
WS/hackathons/conferences:
- DiracX hackathon: 5 and 6 May - https://indico.cern.ch/event/1501369/
- registrations open
- Dirac Users’ Workshop: 17th-20th September 2025 - https://indico.cern.ch/e/duw11
- time to start planning your trip! (you might need a VISA)
- DiracX hackathon: 5 and 6 May - https://indico.cern.ch/event/1501369/
AOB
- Projects for ISIMA students:
took 3only 2 students at the end, starting in about a month!:- Pilot (security model)
Matcher for DiracX (new)- LHCb specific (LHCb extension, also for the Web)
LHCbDIRAC
- https://gitlab.cern.ch/lhcb-dirac/LHCbDIRAC/-/issues/36#note_9026796 : issue closed
- Alexey restarted work on Move getFileDescendents to NewOracleBookkeepingDB
- work on DB done, green light on creating related service/client API for it.
- Federico MR for Parametric sprucing
- few more tests are needed