BiLD-Dev
Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.
Zoom: BiLD
https://cern.zoom.us/j/62504856418?pwd=TU1kb01SOFFpSDBJeWVBdU9qemVXQT09
Meeting ID: 62504856418
Passcode: 12345678
BiLD – 12/12/2024
At CERN: Christophe, Alexandre, Christopher, Ryun
On Zoom: Daniela, Simon, Hideki, Andrei (host), Xiaomei, Janusz, Jorge
Apologies: Federico, André
Follow-up from previous meetings
- Last BiLD was November 28th
- Last DIRAC certification hackathon on December 5th
- Board: https://github.com/orgs/DIRACGrid/projects/21
- Some progress, at least managed to submit jobs and transfers
- 6 issues created (5 for DIRAC, 1 for DiracX)
- Board: https://github.com/orgs/DIRACGrid/projects/21
- Chris LHCb will likely deploy a final prerelease in production early next year (before the end of February). Then others can follow.
DIRAC communities roundtable
LHCb:
Alexandre+Christophe+Christopher+Vladimir
- Running continuously 350K+ jobs concurrently, with latest v8 version.
- Recent worrying issue: the main configuration file (
/opt/dirac/etc/Prod.cfg) suddenly “disappears”.- Created https://github.com/DIRACGrid/DIRAC/pull/7946 to make the writing atomic
- Issue seems to be identified within
m2crypto: hotfixed 2 machines within LHCb- How to create
m2cryptopatch?
- How to create
ILC/Calice/FCC
André
- NTR
EGI
Andrei
- fromPreviousMeeting
- Agreed with the Check-In managers:
- Use a client per VO
- Add wlcg.ver claim to pass token identification on HTCondorCE sites
- This will allow to unblock the situation with pilot submission with tokens; clients are being set up and sites will receive corresponding instructions
- Agreed with the Check-In managers:
- fromPreviousMeeting
- Setting up the diracx test system with K3S in parallel with DIRAC 9.0. It uses external MySQL and ES servers. Work in progress, the installation becomes functional, still more understanding/configuration needed (DEX, cert-manager).
Belle2
Hideki
- Many sites migrating to EL9
- Some sites are not compartible with the bundled proxy when using SSHCE and python3. Hideki will open an issue.
IHEP
Xiaomei
- Migrating the DIRAC servers to Alma9.
- Using tokens for job submission, all sites
- All sites migrated to EL9, all HTCondorCE.
NICA
Igor
- NTR
GridPP:
Daniela, Simon, Janusz
- We upgraded the production server from 8.0.38 to 8.0.60. At least initially no problems were observered, but we are watching the server with interest.
Topics from GitHub/Discussions
only un-answered DIRAC and DiracX topics with discussion updates:
- NTR
DIRAC releases
- v8.0.60
- Resources
CHANGE: (#7913) Add option to include proxy on AREX token submission - WorkloadManagment
CHANGE: (#7907) Better caching performance in the Matching Limiter
- Resources
DIRAC projects
DIRAC:
Issues by milestone:
- v8.0:
- Matcher logging is incorrect
- Solution proposed in https://github.com/DIRACGrid/DIRAC/pull/7924
- fromPreviousMeeting job status transition in ReqClient vs JobStatus
- Andrei will answer
- fromPreviousMeeting Removal of “Systems” part of CS
- Matcher logging is incorrect
- v9.0:
*
- from previous meeting Pilot status for pilots in PollTime related sleep cycle
- interesting discussion, feel free to contribute
PRs discussed:
- NTR
WebApp:
- NTR
Pilot:
- from previous meeting Janusz some doc to write
DIRACOS:
- from previous meeting Installation errors for diracos
Documentation:
- DIRAC is no more en-slaving processes.
OAuth2:
- NTR
management
- from previous meeting Always upload releases to CVMFS
- Looks like fixed

- Looks like fixed
diraccfg
- NTR
DB12
- from previous meeting https://github.com/DIRACGrid/DIRAC/issues/7760#issuecomment-2482420604
- Federico proposed to create “alternate” benchmark
Rucio
- Organization for WS well ongoing. Asked contributions to participants.
Tests
- Updated versions of dependencies used in Integration tests
DiracX:
-
Road Map : https://github.com/chaen/diracx/blob/roadmap/docs/ROADMAP.MD
- This is a slightly reduced version of https://github.com/orgs/DIRACGrid/projects/2/views/2 which includes few operations
- It also suggests that the Matcher should be implemented soon-ish after the first version is out
-
Federico private repo created: https://github.com/DIRACGrid/cs_store_dirac_certif (from https://gitlab.cern.ch/chaen/cs_store_dirac_certif)
- For sync-ing CS to DiracX
- Allowed team “DIRAC Release Manager” (7 members)
- To-Do: Christophe should delete your gitlab repo above to avoid confusion and mis-alignment (copy to github the last changes before doing it)
-
Alexandre created https://www.npmjs.com/org/dirac-grid
Issues
*
PRs discussed:
- fromPreviousMeeting feat: lock file while read, write and refresh token
- fromPreviousMeeting PR(s) for using PostGres: we can not use it as of now, so unfortunaly we will close, but the work has been useful. Christophe will create an issue for not forgetting what we will want to do in the future
- fromPreviousMeeting https://github.com/DIRACGrid/diracx/pull/269
- Chris I will check offline
DiracX-charts:
- fromPreviousMeeting feat(diracx-web): support npm workspaces
release-pleaseaction not fully supported, creating issues
DiracX-web:
- fromPreviousMeeting feat: extension management
- fromPreviousMeeting
- Alexandre
- Improvements to JobMonitoring app
- Added the user’s details at login
- Some tests for the extension needs to be added
- Alexandre
Release planning, tests and certification
-
Certification machines
for next timeFederico will allow aLegacyAdaptorfor JobMonitoring. There is an old PR in DIRAC. Should anyway be tested before v9 is out
-
Next hackathon(s)
- next Thursday (last of the year)
Next appointments
-
Meetings:
- hackathon: next week
- BiLD: On January 9th (maybe will cancel because too close to hackathon of week after)
-
WS/hackathons/conferences:
- DiracX hackathon: 14th-15th January 2025, CERN https://indico.cern.ch/event/1458873/
- Dirac&Rucio mini-workshop and hackathon: 16th-17th January 2025, CERN https://indico.cern.ch/event/1443765/
- around 30 registered participants already, on site (note: we took a slighlty bigger room)
- Dirac Users’ Workshop: 17th-20th September 2025 - https://indico.cern.ch/e/duw11
AOB
- Projects for ISIMA students: took 3 students at the end:
- Pilot (security model)
- Matcher for DiracX (new)
- LHCb specific (LHCb extension, also for the Web)
LHCbDIRAC
- fromPreviousMeeting BKK:
- denormalisation really improved the performances, “works beautifully”
- some tasks coming for Alexey
- having a chat with CERN/IT for DBA help
- repartition to hash of the production ID (hash partition type is a thing in Oracle)
- this should be done by Kate (it doubles the size…)
- repartition to hash of the production ID (hash partition type is a thing in Oracle)
- Alexey Complete check of Luminosity started for Collision24
- looks that earlier runs (around 1000) will need to be fixed
- from previous meeting
- Ryun possibility of running on a subset of a BkQuery for prescaling
- “Merged”
- Ryun’s DAG graphs: we can run “DAGs” in productions (sequentially)
- CWL, one day
- Ryun possibility of running on a subset of a BkQuery for prescaling