BiLD – 04/07/2024

At CERN: Federico, André, Alexandre, Christophe, Loris
On Zoom: Janusz, Hideki, Alexey, Xiaomei
Apologies: Daniela (connected later)

Follow-up from previous meetings

• Last BiLD on May 25th
  • then hackathon + workshop
• Last DIRAC certification hackathon on June 6th
  • last on lbcertifdirac70

DIRAC communities roundtable

LHCb:

 Federico+Alexandre+Christophe+Christopher+Alexey+Loris

• COMPLETED Moved to EL9 boxes (one at a time)
• Migrated to OpenSearch (from OpenDistro)

Belle2

 Hideki

• Completed migration of user proxies to 2048
• DIRACOS2 update ongoing (now on pre-prod)

ILC/Calice/FCC

 André

• FCC IAM: tokens at CERN are working
• ILC VO: DESY VOMS ADMIN , CERN IAM 
  • Any best practices to communicate this with all the sites? VO Card ? Mailing list?
  • (No need to discuss now, probably, just send me things by email!)
  •  Daniela We (Imperial) traditionally get them via the ops prtal announcements.

EGI

 Andrei

• from previous meeting Coping with “too many open files…” problem. Setting nofiles limits per dirac-service|agent process.
  •  Christophe will show what we set in puppet

IHEP

 Xiaomei

• Phase out of VOMS to IAM – should be ~ready

GridPP:

 Simon, Janusz, Daniela

• Fix for multi-VO metadata

Topics from GitHub/Discussions

only un-answered topics with discussion updates:

• wall clock – should be more or less answered
• [SOLVED] getProxyInfo to get group properties

DIRAC releases

• v8r0
  • 8.0.49
    • CHANGE: (#7702) HTCondorCE: UseSSLSubmission: use the generated proxy file for everything, no longer need to have certificate of user present on the server.
    • NEW: (#7698) added possibility to specify UserEnvVariable (pilot option) at CE level
    • CHANGE: (#7692) drop DIRAC_MYSQL_CONNECTION_GRACE_TIME and stalled connections reuse
    • NEW: (#7691) fetch nickname attribute from IAM
    • NEW: (#7683) InputDataAgent: new Option MultiVO, which makes the FileCatalog Query use the author of the DN, rather than the Host, to resolve MultiVO metadata correctly. Fixes #7681

DIRAC projects

DIRAC:

• from previous meeting “RFC” for how/what to use/put in CVMFS
  • The connected PR is ready (only minor corrections might be added there)
  •  Federico will marge it by tomorrow or Monday

Issues by milestone:

• v8.0:
  • Little to no movement (at least for “old” tickets)
• v9.0:
  • Elastic JobParameters improvements: PR created solved most of them

Other issues:

• https://github.com/DIRACGrid/DIRAC/issues/3381

PRs discussed:

• [9.0] jobParametersDB improvements
• [9.0] Added index template for ElasticJobParametersDB
• [9.0] removal of outdated code removes the Optimizer module – anyone ever used it in the extension?
  • no answer…

DiracX:

•  Loris DiracX-Web extensions
  • Slides presented (added to the agendas)
  • In general, approved the work. Several comments, basic summary:
    • even if the components library might be able to run on not only NextJS, we should be careful: we want to support only NextJS
    • the less, the better – we will have to maintain the in the future.
    • We do not have to use the npm index, but simply store on GitHub (check if it is possible)
    • StoryBook for code documentation: is it something that can be used inside readthedocs or docosaurus?
• [CONVERGED] Discussion about pagination: https://github.com/DIRACGrid/diracx/pull/243
• [MERGED] Semantic version, conventional commits, release-please : https://github.com/DIRACGrid/diracx-web/pull/134
  • not yet applied to DiracX,  Alexandre will follow-up
• DiracX documentation proposal: https://github.com/DIRACGrid/diracx/issues/144#issuecomment-2183545258
•  Janusz needs help on PR 269, router not yet included. PilotAgentsDB need to be added too.

WebApp:

• NTR

Pilot:

• from previous meeting  Janusz some doc to write

DIRACOS:

• Installation errors for diracos
• from previous meeting Made a new release with libxml2 downgraded. Issue opened to gfal2 for proper fix
  • FTS/gfal developers are going to look at this now
  • ==> a new release is there, pending in conda-forge
• from previous meeting Requests for Apple-M2 compatibility

Documentation:

• Need to decide on strategy for DiracX documentation –  André to take care?

OAuth2:

• NTR

management

• from previous meeting Always upload releases to CVMFS
  • still not always working
  •  Andrei created a new script, so PR needed

diraccfg

• NTR

DB12

 Alexandre

• NTR

Rucio

• New mattermost channel: https://mattermost.web.cern.ch/diracx/channels/rucio---dirac

Tests

• NTR

Release planning, tests and certification

• Certification machines

  • ccdirac12.in2p3.fr
    •  Federico networking issues still present, so not installed yet
      • right now issues from docker

• Next hackathon(s)

  • next week, on ccdirac12.in2p3.fr (if ready)

AOB

Next hackathon: in 1 week (July 11th) (if the machine will be ready)
Next BiLD: On August 8th?

Next DiracX hackathon: 17th-18th September, CERN: https://indico.cern.ch/event/1431888/ – do register!

Next Dirac Users’ Workshop: https://indico.cern.ch/e/duw11 – maybe could start one day earlier.

•  André Talked with COMPASS/Amber, they are interested to have a look at DIRAC for their production system after the summer (September)
• Lyon WS: participants liked it, found it very useful, even Daniela!
  • it was felt that it could have been longer, with even more time for hackathon/QA
• Group photo from Lyon workshop uploaded at https://indico.cern.ch/event/1341205/attachments/2888705/5063499/Groupe_dirac.jpg

LHCbDIRAC

•  Federico fixed the devel branch pipeline, will take care of rebasing the existing MRs.
• BKK: The getDescendants implementation got faster, but does not have tree-like implementation, so that will need to be done.  Raja will test it soon as it is there.
• lbvoboc can be ditched (but volume saved)