BiLD-Dev
Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.
Zoom: BiLD
https://cern.zoom.us/j/62504856418?pwd=TU1kb01SOFFpSDBJeWVBdU9qemVXQT09
Meeting ID: 62504856418
Passcode: 12345678
BiLD – 04/07/2024
At CERN: Federico, André, Alexandre, Christophe, Loris
On Zoom: Janusz, Hideki, Alexey, Xiaomei
Apologies: Daniela (connected later)
Follow-up from previous meetings
- Last BiLD on May 25th
- then hackathon + workshop
- Last DIRAC certification hackathon on June 6th
- last on lbcertifdirac70
DIRAC communities roundtable
LHCb:
Federico+Alexandre+Christophe+Christopher+Alexey+Loris
- COMPLETED Moved to EL9 boxes (one at a time)
- Migrated to OpenSearch (from OpenDistro)
Belle2
Hideki
- Completed migration of user proxies to 2048
- DIRACOS2 update ongoing (now on pre-prod)
ILC/Calice/FCC
André
- FCC IAM: tokens at CERN are working
- ILC VO: DESY VOMS ADMIN
, CERN IAM
- Any best practices to communicate this with all the sites? VO Card ? Mailing list?
- (No need to discuss now, probably, just send me things by email!)
- Daniela We (Imperial) traditionally get them via the ops prtal announcements.
EGI
Andrei
- from previous meeting Coping with “too many open files…” problem. Setting nofiles limits per dirac-service|agent process.
- Christophe will show what we set in puppet
IHEP
Xiaomei
- Phase out of VOMS to IAM – should be ~ready
GridPP:
Simon, Janusz, Daniela
- Fix for multi-VO metadata
Topics from GitHub/Discussions
only un-answered topics with discussion updates:
- wall clock – should be more or less answered
- [SOLVED] getProxyInfo to get group properties
DIRAC releases
- v8r0
- 8.0.49
- CHANGE: (#7702) HTCondorCE: UseSSLSubmission: use the generated proxy file for everything, no longer need to have certificate of user present on the server.
- NEW: (#7698) added possibility to specify UserEnvVariable (pilot option) at CE level
- CHANGE: (#7692) drop DIRAC_MYSQL_CONNECTION_GRACE_TIME and stalled connections reuse
- NEW: (#7691) fetch nickname attribute from IAM
- NEW: (#7683) InputDataAgent: new Option MultiVO, which makes the FileCatalog Query use the author of the DN, rather than the Host, to resolve MultiVO metadata correctly. Fixes #7681
- 8.0.49
DIRAC projects
DIRAC:
- from previous meeting “RFC” for how/what to use/put in CVMFS
- The connected PR is ready (only minor corrections might be added there)
- Federico will marge it by tomorrow or Monday
Issues by milestone:
- v8.0:
- Little to no movement (at least for “old” tickets)
- v9.0:
- Elastic JobParameters improvements: PR created solved most of them
PRs discussed:
- [9.0] jobParametersDB improvements
- [9.0] Added index template for ElasticJobParametersDB
- [9.0] removal of outdated code removes the
Optimizermodule – anyone ever used it in the extension?- no answer…
DiracX:
- Loris DiracX-Web extensions
- Slides presented (added to the agendas)
- In general, approved the work. Several comments, basic summary:
- even if the components library might be able to run on not only NextJS, we should be careful: we want to support only NextJS
- the less, the better – we will have to maintain the in the future.
- We do not have to use the npm index, but simply store on GitHub (check if it is possible)
StoryBookfor code documentation: is it something that can be used inside readthedocs or docosaurus?
- [CONVERGED] Discussion about pagination: https://github.com/DIRACGrid/diracx/pull/243
- [MERGED] Semantic version, conventional commits, release-please : https://github.com/DIRACGrid/diracx-web/pull/134
- not yet applied to DiracX, Alexandre will follow-up
- DiracX documentation proposal: https://github.com/DIRACGrid/diracx/issues/144#issuecomment-2183545258
- Janusz needs help on PR 269, router not yet included. PilotAgentsDB need to be added too.
WebApp:
- NTR
Pilot:
- from previous meeting Janusz some doc to write
DIRACOS:
- Installation errors for diracos
- from previous meeting Made a new release with
libxml2downgraded. Issue opened togfal2for proper fix- FTS/gfal developers are going to look at this now
- ==> a new release is there, pending in conda-forge
- from previous meeting Requests for Apple-M2 compatibility
Documentation:
- Need to decide on strategy for DiracX documentation – André to take care?
OAuth2:
- NTR
management
- from previous meeting Always upload releases to CVMFS
- still not always working
- Andrei created a new script, so PR needed
diraccfg
- NTR
DB12
Alexandre
- NTR
Rucio
- New mattermost channel: https://mattermost.web.cern.ch/diracx/channels/rucio---dirac
Tests
- NTR
Release planning, tests and certification
-
Certification machines
- ccdirac12.in2p3.fr
- Federico networking issues still present, so not installed yet
- right now issues from docker
- Federico networking issues still present, so not installed yet
- ccdirac12.in2p3.fr
-
Next hackathon(s)
- next week, on ccdirac12.in2p3.fr (if ready)
AOB
Next hackathon: in 1 week (July 11th) (if the machine will be ready)
Next BiLD: On August 8th?
Next DiracX hackathon: 17th-18th September, CERN: https://indico.cern.ch/event/1431888/ – do register!
Next Dirac Users’ Workshop: https://indico.cern.ch/e/duw11 – maybe could start one day earlier.
- André Talked with COMPASS/Amber, they are interested to have a look at DIRAC for their production system after the summer (September)
- Lyon WS: participants liked it, found it very useful, even Daniela!
- it was felt that it could have been longer, with even more time for hackathon/QA
- Group photo from Lyon workshop uploaded at https://indico.cern.ch/event/1341205/attachments/2888705/5063499/Groupe_dirac.jpg
LHCbDIRAC
- Federico fixed the
develbranch pipeline, will take care of rebasing the existing MRs. - BKK: The
getDescendantsimplementation got faster, but does not have tree-like implementation, so that will need to be done. Raja will test it soon as it is there. lbvoboccan be ditched (but volume saved)