BiLD-Dev

Europe/Zurich
Federico Stagni (CERN)
Description

Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

Join Zoom Meeting
https://cern.zoom.us/j/91083694183?pwd=ZkdDY1I1YkJVc2o3UTdBY1BRZE15UT09

Meeting ID: 910 8369 4183
Passcode: 12345678
One tap mobile
+41432107108,,91083694183# Switzerland
+41315280988,,91083694183# Switzerland

Dial by your location
        +41 43 210 71 08 Switzerland
        +41 31 528 09 88 Switzerland
        +41 43 210 70 42 Switzerland
        +33 1 8699 5831 France
        +33 1 7037 2246 France
        +33 1 7037 9729 France
Meeting ID: 910 8369 4183
Find your local number: https://cern.zoom.us/u/artUfAdNB

Join by SIP
91083694183@188.184.89.188
91083694183@188.185.118.153

Join by H.323
188.184.89.188
188.185.118.153
Meeting ID: 910 8369 4183
Passcode: 12345678

 
 

BiLD (Bi-weekly DIRAC Development meeting) – 05/08/2021

At CERN: Federico, Chistophe, Christopher, André (in our offices…)
On Zoom: Alexandre, Andrii, Cedric, Hideki, Janusz, Simon, Ueda
Apologies:

Follow-up from previous meetings

  • Ran hackathon last week on 7.3.0a17:
    • trello board here
    • py2 hackathon on lbcertifdirac70 box
    • VMDIRAC merged in: the dirac.cfg had to be updated again in puppet
    • py3 pilots: some issues with release string parsing, solution merged in
    • usual bunch of fixes

DIRAC communities roundtable

GridPP:

Simon

  • HTCondor MP tests still ongoing

ILC/CLIC/FCC:

André

  • Updated to v7r2
    • Some configuration changes not correctly described in the update notes (corrected now)
      • VOPolicy (One move incompletely described, one completely missing)
      • StatesAccountingAgent (Backend instead of Backends)
      • Please consider this when planning to restructure the Operations section (and don’t)
  • Elasticsearch: testing the new opensearch from CERN, seems to work fine with v7r2

LHCb:

Federico+Christophe+Christopher+Alexandre

  • py3 is the default client (on CVMFS)

EGI:

Andrii

  • NTR

Belle2:

Ueda, Hideki, Cedric

  • NTR

DIRAC releases

  • v7r2p19:
    • Framework
      FIX: ComponentSupervisionAgent: consistently use the actual “Setup”, and not the “instance” to look up options. Note: you might need to change your config from “Production” to “DIRAC-Production” depending on your config.
    • Resources
      NEW: removal throttle for Echo
  • v7r3-pre18:
    • (#5035) use DIRACScript instead of Script
    • (#5214) Added a HTTPs JobManager, JobMonitor, JobStateUpdate service
    • (#5289) SiteDirector: do not send dirac-install if it’s py3 pilot

DIRAC projects

DIRAC:

Issues by milestone:

Other issues:

  • NTR

PRs discussed:

WebApp:

Pilot:

  • Merged devel into master on Monday, looks fine

DIRACOS:

  • New version v1r24
    • Using davix and SQLAlchemy latest version

DIRACOS2:

  • from previous meetingfts-rest on py3?
    • NTR
  • New release 2.9 not released yet

VMDIRAC:

  • Merged. No further developments./

Documentation:

OAuth2:

tornado/HTTPs

management

diraccfg

  • NTR

COMDIRAC

  • NTR

DB12

  • PR is almost ready, should be finished tomorrow
  • pip packages should be deleted, since they are not production

other externals, including Rucio

  • PR https://github.com/DIRACGrid/DIRAC/pull/5302
    • better way on instantiating the client and running the agents, using DIRAC CS and host certificate
    • using the user proxy for running the client
    • Already used by GridPP, question if is Belle2 way of working is preserved, Cedric should have a look.

Release planning, tests and certification

  • Certification machines

    • lbcertifdirac70 machine:
      • py2 installation, for now, but we’ll move to py3 server for the next hackathon
    • lbcertifdiracoath machine:
      • from previous meeting Andrii seems to be ready. One issue on how to organize Registry.
        • client for IAM (approved by Andrea), VO WLCG (not a admin yet) and one client for Check-IN.
      • Federico We can run a non-official hackathon here, only for a few people
  • Next hackathon(s)

    • Federico py3 hackathon on lbcertifdirac70

AOB and topics from Google forum

Next hackathon on August 12th: https://indico.cern.ch/event/1065227/
Next BiLD on August 19th: https://indico.cern.ch/event/1065225/


LHCbDIRAC

  • https://trello.com/b/BQvEbteg/deploy-v10r2
    • ES stuff: we will migrate to OpenSearch, starting from the DIRAC certification, then LHCb certification, and only then Production
  • python3 client on CVMFS is now the default for users
    • Pilots still using py2
  • from previous meetingSandboxStore: installed in prod
    • 80% migrated - rsync-ing
  • Tomorrow LHCbDIRAC hackathon based on v7r3/py2
 
There are minutes attached to this event. Show them.