Focus on:  Hide Contributions
Login

BiLD-Dev

→ Europe/Zurich
Federico Stagni (CERN)
Description

Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

Join Zoom Meeting
https://cern.zoom.us/j/91083694183?pwd=ZkdDY1I1YkJVc2o3UTdBY1BRZE15UT09

Meeting ID: 910 8369 4183
Passcode: 12345678
One tap mobile
+41432107108,,91083694183# Switzerland
+41315280988,,91083694183# Switzerland

Dial by your location
        +41 43 210 71 08 Switzerland
        +41 31 528 09 88 Switzerland
        +41 43 210 70 42 Switzerland
        +33 1 8699 5831 France
        +33 1 7037 2246 France
        +33 1 7037 9729 France
Meeting ID: 910 8369 4183
Find your local number: https://cern.zoom.us/u/artUfAdNB

Join by SIP
91083694183@188.184.89.188
91083694183@188.185.118.153

Join by H.323
188.184.89.188
188.185.118.153
Meeting ID: 910 8369 4183
Passcode: 12345678

working notes
Hide

BiLD (Bi-weekly DIRAC Development meeting) – 24/06/2021

At CERN: Still, nobody :/
On Zoom: Federico, André, Andrei, Andrii, Cedric, Christophe, Christopher, Hideki, Simon, Vladimir
Apologies: Daniela

Follow-up from previous meetings

DIRAC communities roundtable

GridPP:

 Daniela

  • “we are testing v7r2 and I cannot get multicore jobs to work on HTCondorCEs. They get matched, but do not get assigned 8 cores by the batch system. It works for ARCs. I added a UKI-SOUTHGRID-RALPP to the certification server to be able to test this and it looks the same (e.g.2978 & 2975).”

CLIC:

 André

  • CTA moving to production this week

LHCb:

 Federico+Chris+Chris+Marko

  • While running 1st Real Data productions since long time, found a couple bugs
  • Installed ComponentSupervisionAgent on 2 machines, fix in PR (alredy merged) from  Federico+André
  • py3 client on CVMFS, advertised, not yet the default
    • LHCbPilot (MR made, merged, functionality not yet used)

EGI (+ France Grilles):

 Andrei

  • from previous meeting M2Crypto and VOMS extension follow-up (issue)
    • still ongoing
  • from previous meeting ES with certificate access still slow?
    • still ongoing
  • Moved to using Pilot3
  • Some users using curl complain for a very old (2009) version of curl in DIRACOS - can this be updated to something more recent ?
    • issue to be discussed on github

Belle2

 Hideki

  • Migrated to v7r0. Currently working fine. Using DIRACOS (already from v6r22)
    • Using Pilot3, also with extension (on CVMFS)
  • Already starting to think about v7r1 migration

JINR

 Igor

  • working on JobLaunchPad, maybe could be useful also for vanilla DIRAC.

DIRAC releases

  • v7r1p43:
    • improved compatibility with v7r2
  • v7r2p10 + v7r2p11:
    • some py3 improvements
    • (#5189) PoolComputingElement use concurrent.futures.ProcessPoolExecutor + adding a shutdown
      • this fixes a rather important bug on Pool CE, that was exiting before the payloads were completed
    • (#5199) remove CPUScalingFactor calls, should fix some TimeLeft calculations
    • (#5185) Add DIRAC_FEWER_CFG_LOCKS environment variable to significantly improve multithreading performance in CS heavy workloads
      • this should be removed “soon” anyway
      •  Christopher still need DIRACOS for that.
        • The integration test jobs seem to fail a bit more often than the others – should be checked
  • v7r3-pre12 (7.3.0a12):
    • (#5178) JobMonitoring does not need to look into TaskQueue

DIRAC projects

DIRAC:

Issues by milestone:

  • v7r1:
    • A couple of issues opened and already addressed
  • v7r2:
    • Not much movements there
  • v7r3:
    • Not much movements there either

PRs discussed:

WebApp:

Pilot:

  • NTR

DIRACOS:

  • xroot5?
    • NTR
  • condor 9?
    • NTR

DIRACOS2:

  • from previous meetingfts-rest on py3?
    • NTR
  •  Andrii jwt + other token stuff need to be added here

VMDIRAC:

  • from previous meeting Agreed to merge into DIRAC for v7r3
    •  Simon not done yet

Documentation:

OAuth2:

tornado/HTTPs

  •  Federico opened PR for adding HTTPs Matcher
    • moved to a draft after discussion, as Matcher isn’t the best example for moving to https (non-duplicatable). Many things in that PR still good, though

management

  • from previous meeting 1 task left for deploying on CVMFS
    • Not yet done, Marko left, Andrei should take over
  • 3 PRs for py3 installations:

diraccfg

  • one more release will need to go DIRACOS

COMDIRAC

  • NTR

other externals, including Rucio

Release planning, tests and certification

AOB and topics from Google forum

Next hackathon (py3) on July 1st: https://indico.cern.ch/event/1052653/
Next BiLD on July 08th: https://indico.cern.ch/event/1052655/

LHCbDIRAC

There are minutes attached to this event. Show them.