BiLD – 23/05/2024

At CERN: Federico, André, Alexandre, Christophe, Loris
On Zoom: Janusz, Daniela, Andrei, Hideki, Alexey, Chris
Apologies:

Follow-up from previous meetings

• Last BiLD on April 25th
  • Then holiday period + WLCG WS
• Last DIRAC certification hackathon on April 18th
  • Cancelled the one on May 2nd as not enough to test

DIRAC communities roundtable

LHCb:

 Federico+Alexandre+Christophe+Christopher

• Moving to EL9 boxes (one at a time)
• ARM nodes:
  • ran tests (MC production jobs) but still https://github.com/DIRACGrid/DIRAC/pull/7589 should be addressed
    • the currently proposed implementation is heavily LHCb-inspired, but at the moment we do not have anything else

Belle2

 Hideki

• Moved to v8 

ILC/Calice/FCC

 André

• Started using SingularityCE, would like more freedom to chose Container image, essentially per job
  •  Federico SingularityCE is mostly there for isolation purposes, not for application support

EGI

 Andrei

• Coping with “too many open files…” problem. Setting nofiles limits per dirac-service|agent process.
  •  Christophe will show what we set in puppet
• Some communuties running applications inside container while installing the container itself (apptainer or udocker)

GridPP:

 Simon, Janusz, Daniela

• Today is upgrade to Rocky 9 day !
• We ran into a “not sure if this is a feature of a bug” issue yesterday: https://ggus.eu/index.php?mode=ticket_info&ticket_id=166820
  •  Andrei Can use a “DIRAC-only” CE name, and “host” option insde its CS definition

Topics from GitHub/Discussions

• There is an IAM hackathon at the end of May: https://indico.cern.ch/event/1401472/
  Daniela and Simon are going 
  (Daniela has now agreed to act as an enforcer to IAM issues raised by Chris. Chris to supply list of issues.)

only un-answered topics with discussion updates:

• To sychronize user list from IAM?
  • Transformed into issue https://github.com/DIRACGrid/DIRAC/issues/7416 and draft PR https://github.com/DIRACGrid/DIRAC/pull/7612
  •  Christophe there are still syncronization issues between VOMS and IAM
  •  Daniela we have ported VOMS to Rocky9.
    • this might become a “temporary” solution in case issues with IAM are not solved on time
• problem with dirac-proxy-init
  • needs further info

DIRAC releases

• v8r0
  *
• v9r0
  *

DIRAC projects

DIRAC:

• “RFC” for how/what to use/put in CVMFS
  • it is “OK”-ish

Issues by milestone:

• v8.0:
  • 10+ open issues, not much movements
• v9.0:
  • 20 open issues, as usual some movements

Other issues:

• NTR

PRs discussed:

• NTR

DiracX:

• New DiracX version 0.0.1a14, mostly for fixing DIRAC CI
• Several large-ish PRs to be evaluated
• Web: https://github.com/DIRACGrid/diracx-web/pull/131 (already merged)
  • dashboard with draggable applications and groups
  • applications and their states are saved directly in the URL: can easily share a whole set of application through a simple link (might hit some URL length limitations at some point but it works well for what we have now).

• Discussion about pagination: https://github.com/DIRACGrid/diracx/pull/243

• Semantic version, conventional commits, release-please : https://github.com/DIRACGrid/diracx-web/pull/134

• Logo proposal:
  

  • logo is fine
  • we should have all the material in the management repo

WebApp:

• NTR

Pilot:

• ? Removed python2 releases ?
• from previous meeting  Janusz some doc to write

DIRACOS:

• from previous meeting 2.39

  • Use apptainer 1.2.5
    • This is a backporting (?) as response for https://github.com/apptainer/apptainer/issues/2166 (which will be fixed by developers in 1.3.2) and originated from https://ggus.eu/index.php?mode=ticket_info&ticket_id=166225
  • Added cwltool

• from previous meeting Made a new release with libxml2 downgraded. Issue opened to gfal2 for proper fix

  • FTS/gfal developers are going to look at this now
  • ==> a new release is there, pending in conda-forge

• from previous meeting Requests for Apple-M2 compatibility

Documentation:

• NTR

OAuth2:

• NTR

management

• from previous meeting Always upload releases to CVMFS
  • still not always working
  •  Andrei created a new script, so PR needed

diraccfg

• NTR

DB12

 Alexandre

• NTR

Rucio

• NTR

Tests

Release planning, tests and certification

• Certification machines

  • Vanessa created a Alma9 machine:
    •  Federico I can login (with SSH key) and become dirac
    • Still to discuss what to do with the databases

• Next hackathon(s)

  • next week

AOB

Next hackathon: in 1 week (May 30th)
Next BiLD: in 2 weeks (June 6th)

• Next DIRAC Users’ workshop in Lyon https://indico.cern.ch/e/duw10 June 19th->21st
  •  Federico started filling in the agenda
    • the usual suspects will be asked to give the VO report
    • the topics are up to proposal (this is an informal “call for abstract”)

LHCbDIRAC

• v11.0: deploy board in https://trello.com/b/Ep0PAkbv/deploy-110
  • NTR
• Added the same workflow tests also added for DIRAC (MR ready)
• VOMS backend will be shutdown in June 24
  • from previous meeting we need to make sure that all links will be updated
    •  Christophe will do adiabatically over the coming weeks
• OpenSearch migration?
  • we should have a proper downtime on our side
• BKK:
  • few minor issues to be solved with existing DQ flags features
  • will start moving to new BookkeepingDB class (one method after the other)