BiLD – 25/04/2024

At CERN: André, Alexandre, Christophe, Chris,
On Zoom: Janusz, Daniela, Simon, Andrei, Hideki, Janusz, Vladimir, Alexey, Cedric
Apologies: Federico (last minute)

Follow-up from previous meetings

• Last BiLD on April 4th
• Last DIRAC certification hackathon on April 18th
  • Ran using https://github.com/orgs/DIRACGrid/projects/12
  • Pretty OK, but discovered 2 bugs coming from v8 (fixed promptly)
  • 3 cards transformed into DIRAC issues

DIRAC communities roundtable

LHCb:

 Federico+Alexandre+Christophe+Christopher

• Moving to EL9 boxes (slowly)
• ARM nodes:
  • Having some ARM queue to interact with
  • Specific ContainerRoot added for SingularityCE, not ideal nor enough so created PR https://github.com/DIRACGrid/DIRAC/pull/7589 and the optional https://github.com/DIRACGrid/Pilot/pull/239

Belle2

 Hideki

• Finishing validation of DIRAC 8.0. Aiming at mid-May. Still have to upgrade proxies from 1024 to 2048.

ILC/Calice/FCC

 André

• NTR

EGI

 Andrei

• Problems with the /cvmfs/dirac.egi.eu repo sychronization. New uploader server is being put into operation

JINR

 Igor

GridPP:

 Simon, Janusz, Daniela

• Nothing to report. Next on the list is porting our production server to Rocky 9 (the pre-prod ones already are)

Topics from GitHub/Discussions

There is an IAM hackathon at the end of May: https://indico.cern.ch/event/1401472/
(Daniela is trying to convince Simon to go, but so far no luck.)
only un-answered topics with discussion updates:

• from previous meeting Old ARC CE interface?
  • the configuration would need to move from “ARC” to “AREX” and in theory it would still work everywhere
• To sychronize user list from IAM?

DIRAC releases

• v8r0
  • v8.0.42 found to be buggy, so created immediately after v8.0.43
  • v8.0.43 (“just” fixes):
    • deployment: issues with condaforge and CVMFS
  • v8.0.44
    • File.secureOpenForWrite: fix exception when opening in binary mode, fixes #7581
• v9r0
  *

DIRAC projects

DIRAC:

•  Federico would like to briefly discuss this “RFC” for how/what to use/put in CVMFS

Issues by milestone:

• v8.0:
  • 10+ open issues, not much movements
• v9.0:
  • 20 open issues, as usual some movements
  • Reducing the memory consumption of the PushJobAgent
    • 2 out of 3 bullets “done”, through 2 merged PRs (also tested for regressions), 3rd PR in draft
  • [8.0] Implementation of metadata methods into RucioFileCatalogClient closes issue #7382

Other issues:

• CentOS 7 EOL
  • Almost completed

PRs discussed:

• [8.0] feat: SingularityCE: looking for the platform-aware image in CVMFS locations
• No objections to the proposed CVMFS repo struture.

DiracX:

• New DiracX version 0.0.1a13 was installed and working in OpenShift at CERN.

WebApp:

• PRs with fixes merged, new production release created 2 days ago

Pilot:

• New version: https://github.com/DIRACGrid/DIRAC/discussions/7512#discussioncomment-9212357
  • Compatibility with python 3.12 added
  • use another environment variable to spot pilots running in htcondor
• ? Removed python2 releases ?
• from previous meeting  Janusz some doc to write

DIRACOS:

• New release yesterday: 2.39

  • Use apptainer 1.2.5
    • This is a backporting (?) as response for https://github.com/apptainer/apptainer/issues/2166 (which will be fixed by developers in 1.3.2) and originated from https://ggus.eu/index.php?mode=ticket_info&ticket_id=166225
  • Added cwltool

• from previous meeting Made a new release with libxml2 downgraded. Issue opened to gfal2 for proper fix

  • FTS/gfal developers are going to look at this now
  • ==> a new release is there, pending in conda-forge

• Requests for Apple-M2 compatibility

Documentation:

• Fixed the issue with the WorkflowXMLHandler circular import showing up randomly

OAuth2:

• IAM hackathon 29-30 May, nice if somebody goes there

management

• from previous meeting Always upload releases to CVMFS
  • 25th Apr working! but sometimes is slow
• fix: use docker login should fix security issues, review requested

diraccfg

• NTR

DB12

 Alexandre

• from previous meeting
  •  Ewoud opened PR for py3.11 (in progress)
    • missing the Intel vs AMD
  •  Federico Can we have DB12 run on ARM
    • André : I access two “real” ARM machines through OpenStack that can be used for the tests
    • Federico: passed to Ewoud
    • hepscore and ARM: https://ggus.eu/index.php?mode=ticket_info&ticket_id=164939 (Imperial’s ARM is still very much in the “setting it up stage”

Rucio

• NTR

Tests

• Completing the “grid-in-a-box” test with https://github.com/DIRACGrid/DIRAC/pull/7570 which adds a new Pilot Container to the docker-compose setup
  • works fine also for DIRAC extensions

Release planning, tests and certification

• Certification machines

  • Vanessa created a Alma9 machine:
    •  Federico I can login (with SSH key) and become dirac

• Next hackathon(s)
  *

AOB

Next hackathon: in 1 week (May 2nd)
Next BiLD: May 9th is CERN holiday, Thursday 16th is WLCG+HSF WS, so called for May 23rd

• Next DIRAC Users’ workshop in Lyon https://indico.cern.ch/e/duw10 June 19th->21st

  • registrations open, posters sent

• CHEP abstracts submission: deadline May 10th: https://indico.cern.ch/event/1338689/abstracts/#submit-abstract (conference in October…)

  •  Alexandre one abstract for CWL
  • ?

LHCbDIRAC

• v11.0: deploy board in https://trello.com/b/Ep0PAkbv/deploy-110
  *
• Added the same workflow tests also added for DIRAC
• VOMS backend will be shutdown in June 24
  • from previous meeting we need to make sure that all links will be updated
    •  Christophe will do adiabatically over the coming weeks
• OpenSearch migration?
  *
• BKK MRs:
• LHCb CHEP abstracts collected in https://codimd.web.cern.ch/rH76Sy7BSbCx6BCqdNLx5g#