BiLD-Dev
Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.
Zoom: BiLD
https://cern.zoom.us/j/62504856418?pwd=TU1kb01SOFFpSDBJeWVBdU9qemVXQT09
Meeting ID: 62504856418
Passcode: 12345678
BiLD – 23/05/2024
At CERN: Federico, André, Alexandre, Christophe, Loris
On Zoom: Janusz, Daniela, Andrei, Hideki, Alexey, Chris
Apologies:
Follow-up from previous meetings
- Last BiLD on April 25th
- Then holiday period + WLCG WS
- Last DIRAC certification hackathon on April 18th
- Cancelled the one on May 2nd as not enough to test
DIRAC communities roundtable
LHCb:
Federico+Alexandre+Christophe+Christopher
- Moving to EL9 boxes (one at a time)
- ARM nodes:
- ran tests (MC production jobs) but still https://github.com/DIRACGrid/DIRAC/pull/7589 should be addressed
- the currently proposed implementation is heavily LHCb-inspired, but at the moment we do not have anything else
- ran tests (MC production jobs) but still https://github.com/DIRACGrid/DIRAC/pull/7589 should be addressed
Belle2
Hideki
- Moved to v8
ILC/Calice/FCC
André
- Started using SingularityCE, would like more freedom to chose Container image, essentially per job
- Federico SingularityCE is mostly there for isolation purposes, not for application support
EGI
Andrei
- Coping with “too many open files…” problem. Setting nofiles limits per dirac-service|agent process.
- Christophe will show what we set in puppet
- Some communuties running applications inside container while installing the container itself (apptainer or udocker)
GridPP:
Simon, Janusz, Daniela
- Today is upgrade to Rocky 9 day !
- We ran into a “not sure if this is a feature of a bug” issue yesterday: https://ggus.eu/index.php?mode=ticket_info&ticket_id=166820
- Andrei Can use a “DIRAC-only” CE name, and “host” option insde its CS definition
Topics from GitHub/Discussions
- There is an IAM hackathon at the end of May: https://indico.cern.ch/event/1401472/
Daniela and Simon are going
(Daniela has now agreed to act as an enforcer to IAM issues raised by Chris. Chris to supply list of issues.)
only un-answered topics with discussion updates:
- To sychronize user list from IAM?
- Transformed into issue https://github.com/DIRACGrid/DIRAC/issues/7416 and draft PR https://github.com/DIRACGrid/DIRAC/pull/7612
- Christophe there are still syncronization issues between VOMS and IAM
- Daniela we have ported VOMS to Rocky9.
- this might become a “temporary” solution in case issues with IAM are not solved on time
- problem with dirac-proxy-init
- needs further info
DIRAC releases
- v8r0
* - v9r0
*
DIRAC projects
DIRAC:
- “RFC” for how/what to use/put in CVMFS
- it is “OK”-ish
Issues by milestone:
- NTR
PRs discussed:
- NTR
DiracX:
- New DiracX version 0.0.1a14, mostly for fixing DIRAC CI
- Several large-ish PRs to be evaluated
- Web: https://github.com/DIRACGrid/diracx-web/pull/131 (already merged)
- dashboard with draggable applications and groups
- applications and their states are saved directly in the URL: can easily share a whole set of application through a simple link (might hit some URL length limitations at some point but it works well for what we have now).
-
Discussion about pagination: https://github.com/DIRACGrid/diracx/pull/243
-
Semantic version, conventional commits, release-please : https://github.com/DIRACGrid/diracx-web/pull/134
-
Logo proposal:
- logo is fine
- we should have all the material in the management repo
WebApp:
- NTR
Pilot:
- ? Removed python2 releases ?
- from previous meeting Janusz some doc to write
DIRACOS:
-
from previous meeting 2.39
- Use apptainer 1.2.5
- This is a backporting (?) as response for https://github.com/apptainer/apptainer/issues/2166 (which will be fixed by developers in 1.3.2) and originated from https://ggus.eu/index.php?mode=ticket_info&ticket_id=166225
- Added cwltool
- Use apptainer 1.2.5
-
from previous meeting Made a new release with
libxml2
downgraded. Issue opened togfal2
for proper fix- FTS/gfal developers are going to look at this now
- ==> a new release is there, pending in conda-forge
-
from previous meeting Requests for Apple-M2 compatibility
Documentation:
- NTR
OAuth2:
- NTR
management
- from previous meeting Always upload releases to CVMFS
- still not always working
- Andrei created a new script, so PR needed
diraccfg
- NTR
DB12
Alexandre
- NTR
Rucio
- NTR
Tests
Release planning, tests and certification
-
Certification machines
- Vanessa created a Alma9 machine:
- Federico I can login (with SSH key) and become
dirac
- Still to discuss what to do with the databases
- Federico I can login (with SSH key) and become
- Vanessa created a Alma9 machine:
-
Next hackathon(s)
- next week
AOB
Next hackathon: in 1 week (May 30th)
Next BiLD: in 2 weeks (June 6th)
- Next DIRAC Users’ workshop in Lyon https://indico.cern.ch/e/duw10 June 19th->21st
- Federico started filling in the agenda
- the usual suspects will be asked to give the VO report
- the topics are up to proposal (this is an informal “call for abstract”)
- Federico started filling in the agenda
LHCbDIRAC
- v11.0: deploy board in https://trello.com/b/Ep0PAkbv/deploy-110
- NTR
- Added the same workflow tests also added for DIRAC (MR ready)
- VOMS backend will be shutdown in June 24
- from previous meeting we need to make sure that all links will be updated
- Christophe will do adiabatically over the coming weeks
- from previous meeting we need to make sure that all links will be updated
- OpenSearch migration?
- we should have a proper downtime on our side
- BKK:
- few minor issues to be solved with existing DQ flags features
- will start moving to new BookkeepingDB class (one method after the other)