BiLD-Dev

→ Europe/Zurich
Federico Stagni (CERN)
Description

Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

Join Zoom Meeting
https://cern.zoom.us/j/91083694183?pwd=ZkdDY1I1YkJVc2o3UTdBY1BRZE15UT09

Meeting ID: 910 8369 4183
Passcode: 12345678
One tap mobile
+41432107108,,91083694183# Switzerland
+41315280988,,91083694183# Switzerland

Dial by your location
        +41 43 210 71 08 Switzerland
        +41 31 528 09 88 Switzerland
        +41 43 210 70 42 Switzerland
        +33 1 8699 5831 France
        +33 1 7037 2246 France
        +33 1 7037 9729 France
Meeting ID: 910 8369 4183
Find your local number: https://cern.zoom.us/u/artUfAdNB

Join by SIP
91083694183@188.184.89.188
91083694183@188.185.118.153

Join by H.323
188.184.89.188
188.185.118.153
Meeting ID: 910 8369 4183
Passcode: 12345678

 
 

BiLD (Bi-weekly DIRAC Development meeting) – 18/08/2022

On Zoom: Federico, Christophe, Christopher, Cedric, Simon F, Simon M, Xiaomei, Janusz, Alexey, Ueda, Igor
Apologies: Andrei

Follow-up from previous meetings

DIRAC communities roundtable

GridPP:

SimonF+Janusz

  • Using v7r3 and py3.
  • Now using CloudComputingElement in production. Using Singularity too and PoolCE together (with patched version).

LHCb:

Federico+Christophe+Christopher+Alexandre+SimonM+Alexey

  • Running latest v7.3.27
  • MySQL DBs: Moved from BLOBs to TEXTs everywhere (a downtime was necessary)
  • Moved all ElasticSearch to OpenSearch (no issues)
  • Have yet to run an LHCbDIRAC hackathon using DIRAC 8.0 as base
  • from previous meeting Andrei to LHCb
    • Further details about the optimizations performed would be interesting.

Federico details of the update could be found in https://codimd.web.cern.ch/5-ImZHjFTi6ko_a-5-5BFw#

  • How many concurrent MySQL connections do you support?
    • André 1000 should be the max
mysql> show session variables like '%connections%';
Variable_name 	Value
max_connections 	1000
max_user_connections 	1000 

ILC/CLIC/FCC/Calice:

André

  • NTR

EGI:

no one

  • NTR

Belle2

Ueda

  • Running on v7r2 since end of July (still py2)
  • from previous meeting Anil Presented ideas on using the Rucio data popularity features in Belle II. A link to the presentation has been added.

BES, Juno

Xiaomei

  • Just migrated to 7.3.20 (py3). Mostly fine, still some issues with using CloudComputingElement, still few issues – lots of progress thanks to SimonF.

Nica

Igor

  • Everything is fine. Started migrated to v7.3.27. Added small fixes to documentation.
  • Moving servers to bare metal

Topics from GitHub/Discussions or Google forum

only un-answered topics below:

DIRAC releases

  • v7r2:
    • v7r2p48
      • FIX: (#6223) Increase VOMS command timeout
      • FIX: (#6265) Fix FC change{group,owner,mode} for multiple LFNs
      • FIX: (#6230) remove REST information from the ARC6 pilot job references to bind them with jobs
    • rel-v7r2 HEAD:
      • uses suds (only affects py3 clients)
  • v7r3
    • v7.3.26
      • FIX: (#6274) Conditional FC ProxyPlugin checks the ThreadConfig
    • v7.3.27
      • CHANGE: (#6284) Make GOCDB2CSAgent functionMap less private
      • Fix for ReqDB and BLOB (see above)
    • rel-v7r3 HEAD:
      • Few fixes merged (mostly Computing Resources), tag needed
  • integration
    • v8.0.0a27 tagged few weeks ago, since then many new fixes.

DIRAC projects

DIRAC:

Issues by milestone:

Other issues:

PRs discussed:

WebApp:

  • Just 1 PR open, Christopher will fix it.

Pilot:

DIRACOS2:

Documentation:

OAuth2:

tornado/HTTPs

  • One release of our tornado fork for supporting python 3.10

management

  • Added a few recipes (PRs already merged)

diraccfg

  • Christopher Do we want to make a release that drops support for py2?
    • yes

COMDIRAC

  • Merge in DIRAC? https://github.com/DIRACGrid/DIRAC/discussions/6157
    • from previous meeting Andrei This is a good idea to merge COMDIRAC but there are quite a number of subtle technical implications. Suggestion is to have a discussion among interested developers (Andrei, Andrii, Daniela, Simon) and come up with a proposal to be discussed at some future BiLD.

DB12

  • NTR

Rucio

Release planning, tests and certification

8.0 release

  • Create 8.0 release? LHCbDIRAC hackathon tomorrow, then we decide
  • Christpher remove the various six from everywhere?
    • yes

Certification machines

  • lbcertifdirac70 machine:
    • NTR
  • lbcertifdiracoauth machine:
    • NTR

Next hackathon(s)

  • from previous meeting Computing Element of each supported type should be configured (HTCondorCE, 2 ARCS (Alexandre), 2 Clouds (Daniela), SSH). Consider OAuth tests as well - what is needed as far as certification servers configuration is concerned.

AOB

Next hackathon on September 1st?
Next BiLD on September 15th?

from previous meeting An ARC/HTCondor CE Hackathon will happen on September 15th-16th in Amsterdam: https://indico.nikhef.nl/event/3612/. It would be good if one of us would participate.


LHCbDIRAC

 
There are minutes attached to this event. Show them.
    • 10:00 → 10:10
      Items from Previous BiLD-Dev 10m
    • 10:10 → 10:20
      DIRAC Communities roundtable 10m
    • 10:20 → 10:30
      DIRAC releases 10m
    • 10:30 → 10:55
      DIRAC projects 25m
      • DIRAC
      • WebApp
      • Pilot
      • DIRACOS
      • DIRACOS2
      • VMDIRAC
      • Documentation
      • OAuth2
      • tornado/HTTPs
      • other externals (include Rucio)
    • 10:55 → 11:00
      Release planning, tests and certification 5m
    • 11:00 → 11:15
      Weekly development(s) focus 15m
    • 11:15 → 11:25
      AOB
      Convener: Federico Stagni (CERN)
    • 11:25 → 11:40
      LHCbDIRAC 15m