BiLD-Dev

Europe/Zurich
2/R-014 (CERN)

2/R-014

CERN

10
Show room on map
Federico Stagni (CERN)
Description

Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

Zoom: BiLD
https://cern.zoom.us/j/62504856418?pwd=TU1kb01SOFFpSDBJeWVBdU9qemVXQT09

Meeting ID: 62504856418
Passcode: 12345678
 

Zoom Meeting ID
62504856418
Host
Federico Stagni
Useful links
Join via phone
Zoom URL

BiLD – 04/07/2024

At CERN: Federico, André, Alexandre, Christophe, Loris
On Zoom: Janusz, Hideki, Alexey, Xiaomei
Apologies: Daniela (connected later)

Follow-up from previous meetings

  • Last BiLD on May 25th
    • then hackathon + workshop
  • Last DIRAC certification hackathon on June 6th
    • last on lbcertifdirac70

DIRAC communities roundtable

LHCb:

 Federico+Alexandre+Christophe+Christopher+Alexey+Loris

  • COMPLETED Moved to EL9 boxes (one at a time)
  • Migrated to OpenSearch (from OpenDistro)

Belle2

 Hideki

  • Completed migration of user proxies to 2048
  • DIRACOS2 update ongoing (now on pre-prod)

ILC/Calice/FCC

 André

  • FCC IAM: tokens at CERN are working
  • ILC VO: DESY VOMS ADMIN:chart_with_downwards_trend: , CERN IAM :chart_with_upwards_trend:
    • Any best practices to communicate this with all the sites? VO Card ? Mailing list?
    • (No need to discuss now, probably, just send me things by email!)
    •  Daniela We (Imperial) traditionally get them via the ops prtal announcements.

EGI

 Andrei

  • from previous meeting Coping with “too many open files…” problem. Setting nofiles limits per dirac-service|agent process.
    •  Christophe will show what we set in puppet

IHEP

 Xiaomei

  • Phase out of VOMS to IAM – should be ~ready

GridPP:

 Simon, Janusz, Daniela

  • Fix for multi-VO metadata

Topics from GitHub/Discussions

only un-answered topics with discussion updates:

DIRAC releases

  • v8r0
    • 8.0.49
      • CHANGE: (#7702) HTCondorCE: UseSSLSubmission: use the generated proxy file for everything, no longer need to have certificate of user present on the server.
      • NEW: (#7698) added possibility to specify UserEnvVariable (pilot option) at CE level
      • CHANGE: (#7692) drop DIRAC_MYSQL_CONNECTION_GRACE_TIME and stalled connections reuse
      • NEW: (#7691) fetch nickname attribute from IAM
      • NEW: (#7683) InputDataAgent: new Option MultiVO, which makes the FileCatalog Query use the author of the DN, rather than the Host, to resolve MultiVO metadata correctly. Fixes #7681

DIRAC projects

DIRAC:

  • from previous meeting “RFC” for how/what to use/put in CVMFS
    • The connected PR is ready (only minor corrections might be added there)
    •  Federico will marge it by tomorrow or Monday

Issues by milestone:

Other issues:

PRs discussed:

DiracX:

  •  Loris DiracX-Web extensions
    • Slides presented (added to the agendas)
    • In general, approved the work. Several comments, basic summary:
      • even if the components library might be able to run on not only NextJS, we should be careful: we want to support only NextJS
      • the less, the better – we will have to maintain the in the future.
      • We do not have to use the npm index, but simply store on GitHub (check if it is possible)
      • StoryBook for code documentation: is it something that can be used inside readthedocs or docosaurus?
  • [CONVERGED] Discussion about pagination: https://github.com/DIRACGrid/diracx/pull/243
  • [MERGED] Semantic version, conventional commits, release-please : https://github.com/DIRACGrid/diracx-web/pull/134
    • not yet applied to DiracX,  Alexandre will follow-up
  • DiracX documentation proposal: https://github.com/DIRACGrid/diracx/issues/144#issuecomment-2183545258
  •  Janusz needs help on PR 269, router not yet included. PilotAgentsDB need to be added too.

WebApp:

  • NTR

Pilot:

  • from previous meeting  Janusz some doc to write

DIRACOS:

  • Installation errors for diracos
  • from previous meeting Made a new release with libxml2 downgraded. Issue opened to gfal2 for proper fix
    • FTS/gfal developers are going to look at this now
    • ==> a new release is there, pending in conda-forge
  • from previous meeting Requests for Apple-M2 compatibility

Documentation:

  • Need to decide on strategy for DiracX documentation –  André to take care?

OAuth2:

  • NTR

management

diraccfg

  • NTR

DB12

 Alexandre

  • NTR

Rucio

Tests

  • NTR

Release planning, tests and certification

  • Certification machines

    • ccdirac12.in2p3.fr
      •  Federico networking issues still present, so not installed yet
        • right now issues from docker
  • Next hackathon(s)

AOB

Next hackathon: in 1 week (July 11th) (if the machine will be ready)
Next BiLD: On August 8th?

Next DiracX hackathon: 17th-18th September, CERN: https://indico.cern.ch/event/1431888/ – do register!

Next Dirac Users’ Workshophttps://indico.cern.ch/e/duw11 – maybe could start one day earlier.

  •  André Talked with COMPASS/Amber, they are interested to have a look at DIRAC for their production system after the summer (September)
  • Lyon WS: participants liked it, found it very useful, even Daniela!
    • it was felt that it could have been longer, with even more time for hackathon/QA
  • Group photo from Lyon workshop uploaded at https://indico.cern.ch/event/1341205/attachments/2888705/5063499/Groupe_dirac.jpg

LHCbDIRAC

  •  Federico fixed the devel branch pipeline, will take care of rebasing the existing MRs.
  • BKK: The getDescendants implementation got faster, but does not have tree-like implementation, so that will need to be done.  Raja will test it soon as it is there.
  • lbvoboc can be ditched (but volume saved)
There are minutes attached to this event. Show them.
    • 10:00 10:10
      Items from Previous BiLD-Dev 10m
    • 10:10 10:20
      DIRAC Communities roundtable 10m
    • 10:20 10:30
      DIRAC releases 10m
    • 10:30 10:55
      DIRAC projects 25m
      • DIRAC
      • WebApp
      • Pilot
      • DIRACOS2
      • VMDIRAC
      • Documentation
      • OAuth2
      • DiracX
      • other externals (include Rucio)
    • 10:55 11:00
      Release planning, tests and certification 5m
    • 11:00 11:15
      Weekly development(s) focus 15m
    • 11:15 11:25
      AOB
      Convener: Federico Stagni (CERN)
    • 11:25 11:40
      LHCbDIRAC 15m