BiLDx

Thursday 26 Oct 2023, 10:00 → 12:00 Europe/Zurich

2/R-014 (CERN)

diracx developments meeting

 

Zoom: BiLD
https://cern.zoom.us/j/62504856418?pwd=TU1kb01SOFFpSDBJeWVBdU9qemVXQT09

Meeting ID: 62504856418
Passcode: 12345678

working notes

BiLDX – 26/10/2023

At CERN: Vladimir
On Zoom: Federico, Christophe, Christopher, Ruslan, Cedric, Hideki, Janusz, Andrei, Lorenzo, Simon F, Daniela,
Apologies:

Follow-up from previous meetings

• Last BildX 4 weeks ago (Sept 28th): https://indico.cern.ch/event/1321740/
  • Talked about CWL (continued) and diracx-web
    • https://github.com/DIRACGrid/diracx-web has been created.
  •  Federico presented at the workshop: no objections to the presented chosen software stack, so we are going with it
  •  Federico was there anything in last week’s hackathon about it?
• DiracX hackathon on during the workshop last week:
  *

Progress updates

• DiracX is now installed on CERN openshift against DIRAC certification
  • https://diracx-cert.app.cern.ch/
    • At least Andrei and Federico will be added to GridPP IAM
  • We’ll switch to running our own k8s cluster before releasing
• Created a project board on GitHub for planning the first release
  • Still a work in progress
  • Slowly creating issues and building a roadmap
• Created a new repository (DIRACGrid/container-images) which contains the definitions of the base container images we use
• New mattermost channel
  • Using CERN mattermost to avoid retention issues with slack
  • To join https://mattermost.web.cern.ch/signup_user_complete/?id=6q3ijyna1pfm5niq3dqwq6pz8h&md=link&sbr=su
• Have a machine in australia for running certifications
  • Chosen so we have high latency to CERN
  • Still deciding how best to use it
• Alexandre has started drafting how CWL would look in the production system based on discussions

Topics for discussion

Release planning

• Consensus from Japan is that the next release will be DIRAC v9.0.0
• DIRAC 9 will correspond to DiracX v0.1.0
  • Require DiracX services to be installed along side
• DiracX v0.1.0 milestones
  • Finish database groundwork (multi-VO everywhere, remove DNs, …)
  • Auth layer is complete
  • Fully functional “admin VO”
  • Stable API for services
  • Legacy compatibility mechanism with DIRAC is complete
  • Documentation (architecture, development, deployment, user)
  • JobStateUpdateHandler can be removed from DIRAC
    • Chosen as it’s a relatively simple handler but heavily used by clients and jobs
  • Suggested deployment method for “small” installations
  • Extension support
• Things that won’t (necessarily) be with DIRAC 9
  • “Tasks” (i.e. using celery for Agents/Executors/Optimisers)
  • New web app
  • DiracX CLI
  • New CWL based WMS

Security Model

• Available for review: DIRACGrid/diracx#136
• Already green-lit by Mischa Salle
• If there are no objections, propose to merge at the next BiLD (2nd November)

GitHub discussions

Please give feedback on these by the next BiLDx (or forever hold your peace):

• Who uses request proxies?
• Does the web need to support anonymous access?
• Login page design for the new web app

Next steps

• Next BildX: Nov 16th
• Next DiracX hackathon: TBC

AOB

10:00 → 10:20 diracx

Speakers: Chris Burr (CERN), Christophe Haen (CERN)

10:20 → 10:50 DiracX: Github Discussions, Issues and PRs