BiLD – 28/11/2024
At CERN: Federico, André, Christophe, Alexandre, Christopher, Ryun
On Zoom: Daniela, Simon, Hideki, Andrei, Alexey, Xiaomei, Janusz, Igor, Jorge
Apologies:
Follow-up from previous meetings
- Last BiLD was November 14th
- Last DIRAC certification hackathon on November 21st
DIRAC communities roundtable
LHCb:
Federico+Alexandre+Christopher+Vladimir
ILC/Calice/FCC
André
EGI
Andrei
- Now submitting pilots with CheckIn Token (thanks to Simon), “disguised” to have the WLCG profile (WLCG claim). This needed a hotfix on the CheckIn server
- A single client is used for all VOs, via a CheckIn plugin. This is an agreed solution done together via HTCondor. No work for ARC yet. 2 ways:
- Dozens of site might have to be properly configured for each VO, with a single client
- Alternatively just setup a client/VO in CheckIn (this is what is done for IAM). This seems to be the preferred solution
- fromPreviousMeeting
- Setting up the diracx test system with K3S in parallel with DIRAC 9.0. Struggling with setting up the basic setup (cert-manager, DEX, …)
Belle2
Hideki
- Started to use apptainer, still using own wrapper
NICA
Igor
IHEP
Xiaomei
GridPP:
Daniela, Simon, Janusz
- No change in production, but we would like to discuss the state tokens in ARC. I’ve added the relevant git issue in the issues section.
Topics from GitHub/Discussions
only un-answered DIRAC and DiracX topics with discussion updates:
DIRAC releases
- v8.0.59
- FrameworkSystem
CHANGE: (#7895) Rename TokenManager service classes to follow standard convention for tornado and diset handlers
NEW: (#7888) The DISET version of the TokenManager service
- TransformationSystem
CHANGE: (#7874) the TransformationCleaningAgent forces jobs to KILLED
- WorkloadManagementSystem
CHANGE: (#7891) added ulimit -n 1048575 to pilotwrapper content
NEW: (#7866) for parametric jobs, added the possibility to bulk insert records in JobLoggingDB
CHANGE: (#7886) Use plain proxy for the pilot bundle
DIRAC projects
DIRAC:
Issues by milestone:
Other issues:
PRs discussed:
WebApp:
Pilot:
- from previous meeting Janusz some doc to write
DIRACOS:
Documentation:
OAuth2:
management
diraccfg
DB12
Rucio
Tests
DiracX:
Issues
PRs discussed:
DiracX-charts:
DiracX-web:
- fromPreviousMeeting feat: extension management
- fromPreviousMeeting
- Alexandre
- Improvements to JobMonitoring app
- Added the user’s details at login
- Some tests for the extension needs to be added
Release planning, tests and certification
-
Certification machines
- for next time Federico will allow a
LegacyAdaptor for JobMonitoring (it was there in the past, why not anymore?)
-
Next hackathon(s)
Next appointments
AOB
- Projects for ISIMA students
- LHCb specific (LHCb extension, also for the Web)
- Pilot
LHCbDIRAC
- BKK:
- less on
- but denormalisation really improves the performances, “works beautifully”
- a column was added MR created, (hot)fixed on some machine (for comparisons)
- some tasks coming for Alexey
- having a chat with CERN/IT for DBA help
- repartition to hash of the production ID (hash partition type is a thing in Oracle)
- this should be done by Kate (it doubles the size…)
- Alexey Complete check of Luminosity started for Collision24
- looks that earlier runs (around 1000) will need to be fixed
- from previous meeting
- Ryun possibility of running on a subset of a BkQuery for prescaling
- Ryun’s DAG graphs: we can run “DAGs” in productions (sequentially)
There are minutes attached to this event.
Show them.