Choose timezone
Your profile timezone:
BiLD-Dev
Description
Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.
Zoom: BiLD
https://cern.zoom.us/j/62504856418?pwd=TU1kb01SOFFpSDBJeWVBdU9qemVXQT09
Meeting ID: 62504856418
Passcode: 12345678
BiLD
BiLD – 25/04/2024
At CERN: André, Alexandre, Christophe, Chris,
On Zoom: Janusz, Daniela, Simon, Andrei, Hideki, Janusz, Vladimir, Alexey, Cedric
Apologies: Federico (last minute)
Follow-up from previous meetings
- Last BiLD on April 4th
- Last DIRAC certification hackathon on April 18th
- Ran using https://github.com/orgs/DIRACGrid/projects/12
- Pretty OK, but discovered 2 bugs coming from v8 (fixed promptly)
- 3 cards transformed into DIRAC issues
DIRAC communities roundtable
LHCb:
Federico+Alexandre+Christophe+Christopher
- Moving to EL9 boxes (slowly)
- ARM nodes:
- Having some ARM queue to interact with
- Specific
ContainerRootadded for SingularityCE, not ideal nor enough so created PR https://github.com/DIRACGrid/DIRAC/pull/7589 and the optional https://github.com/DIRACGrid/Pilot/pull/239
Belle2
Hideki
- Finishing validation of DIRAC 8.0. Aiming at mid-May. Still have to upgrade proxies from 1024 to 2048.
ILC/Calice/FCC
André
- NTR
EGI
Andrei
- Problems with the /cvmfs/dirac.egi.eu repo sychronization. New uploader server is being put into operation
JINR
Igor
GridPP:
Simon, Janusz, Daniela
- Nothing to report. Next on the list is porting our production server to Rocky 9 (the pre-prod ones already are)
Topics from GitHub/Discussions
There is an IAM hackathon at the end of May: https://indico.cern.ch/event/1401472/
(Daniela is trying to convince Simon to go, but so far no luck.)
only un-answered topics with discussion updates:
- from previous meeting Old ARC CE interface?
- the configuration would need to move from “ARC” to “AREX” and in theory it would still work everywhere
- To sychronize user list from IAM?
DIRAC releases
- v8r0
- v8.0.42 found to be buggy, so created immediately after v8.0.43
- v8.0.43 (“just” fixes):
- deployment: issues with condaforge and CVMFS
- v8.0.44
- File.secureOpenForWrite: fix exception when opening in binary mode, fixes #7581
- v9r0
*
DIRAC projects
DIRAC:
- Federico would like to briefly discuss this “RFC” for how/what to use/put in CVMFS
Issues by milestone:
- v8.0:
- 10+ open issues, not much movements
- v9.0:
- 20 open issues, as usual some movements
- Reducing the memory consumption of the PushJobAgent
- 2 out of 3 bullets “done”, through 2 merged PRs (also tested for regressions), 3rd PR in draft
- [8.0] Implementation of metadata methods into RucioFileCatalogClient closes issue #7382
- CentOS 7 EOL
- Almost completed
PRs discussed:
- [8.0] feat: SingularityCE: looking for the platform-aware image in CVMFS locations
- No objections to the proposed CVMFS repo struture.
DiracX:
- New DiracX version 0.0.1a13 was installed and working in OpenShift at CERN.
WebApp:
- PRs with fixes merged, new production release created 2 days ago
Pilot:
- New version: https://github.com/DIRACGrid/DIRAC/discussions/7512#discussioncomment-9212357
- Compatibility with python 3.12 added
- use another environment variable to spot pilots running in htcondor
- ? Removed python2 releases ?
- from previous meeting Janusz some doc to write
DIRACOS:
-
New release yesterday: 2.39
- Use apptainer 1.2.5
- This is a backporting (?) as response for https://github.com/apptainer/apptainer/issues/2166 (which will be fixed by developers in 1.3.2) and originated from https://ggus.eu/index.php?mode=ticket_info&ticket_id=166225
- Added cwltool
- Use apptainer 1.2.5
-
from previous meeting Made a new release with
libxml2downgraded. Issue opened togfal2for proper fix- FTS/gfal developers are going to look at this now
- ==> a new release is there, pending in conda-forge
-
Requests for Apple-M2 compatibility
Documentation:
- Fixed the issue with the WorkflowXMLHandler circular import showing up randomly
OAuth2:
- IAM hackathon 29-30 May, nice if somebody goes there
management
- from previous meeting Always upload releases to CVMFS
- 25th Apr working! but sometimes is slow
- fix: use docker login should fix security issues, review requested
diraccfg
- NTR
DB12
Alexandre
- from previous meeting
- Ewoud opened PR for py3.11 (in progress)
- missing the Intel vs AMD
- Federico Can we have DB12 run on ARM
- André : I access two “real” ARM machines through OpenStack that can be used for the tests
- Federico: passed to Ewoud
- hepscore and ARM: https://ggus.eu/index.php?mode=ticket_info&ticket_id=164939 (Imperial’s ARM is still very much in the “setting it up stage”
- Ewoud opened PR for py3.11 (in progress)
Rucio
- NTR
Tests
- Completing the “grid-in-a-box” test with https://github.com/DIRACGrid/DIRAC/pull/7570 which adds a new Pilot Container to the docker-compose setup
- works fine also for DIRAC extensions
Release planning, tests and certification
-
Certification machines
- Vanessa created a Alma9 machine:
- Federico I can login (with SSH key) and become
dirac
- Federico I can login (with SSH key) and become
- Vanessa created a Alma9 machine:
-
Next hackathon(s)
*
AOB
Next hackathon: in 1 week (May 2nd)
Next BiLD: May 9th is CERN holiday, Thursday 16th is WLCG+HSF WS, so called for May 23rd
-
Next DIRAC Users’ workshop in Lyon https://indico.cern.ch/e/duw10 June 19th->21st
- registrations open, posters sent
-
CHEP abstracts submission: deadline May 10th: https://indico.cern.ch/event/1338689/abstracts/#submit-abstract (conference in October…)
- Alexandre one abstract for CWL
- ?
LHCbDIRAC
- v11.0: deploy board in https://trello.com/b/Ep0PAkbv/deploy-110
* - Added the same workflow tests also added for DIRAC
- VOMS backend will be shutdown in June 24
- from previous meeting we need to make sure that all links will be updated
- Christophe will do adiabatically over the coming weeks
- from previous meeting we need to make sure that all links will be updated
- OpenSearch migration?
* - BKK MRs:
- LHCb CHEP abstracts collected in https://codimd.web.cern.ch/rH76Sy7BSbCx6BCqdNLx5g#
There are minutes attached to this event.
Show them.
