BiLD-Dev

Europe/Zurich
2-R-014 (CERN)

2-R-014

CERN

Federico Stagni (Conseil Europeen Recherche Nucl. (CERN)-Unknown-Unknown)
Description
Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

At CERN: Federico, Christophe, Andre' Marko, Louis.
On Vidyo: Xiaomei, Daniela, Simon, Wojtek

Apologies: 

 

Follow-up from previous meeting

  • python3 workplan: thread started, to revive

Current situation

DIRAC

  • v6r20p9 out
    • FTS3: several fixes
    • introduced a "QuarantineGroup" in CS/Registry section for avoiding restore or default group
    • some fixes to bulk submission from WorkflowTaskAgent

WebApp:

  • NTR

Pilot3:

  • NTR

Externals:

  • NTR

DIRACOS:

  • Size of the tarball: 300MB (1.2 GB when expanded)
    • Not so many possibility for further  compression

LCG bundles:

  • NTR

REST:

  • NTR  

BOINC:

  • NTR

PyGSI:

  • NTR


Documentation

  • Agreed to use the `..literalinclude` magic for including in the agents' docstring what is in the ConfigTemplate.cfg files
    • Andre' will update the developers' docs
  • Andre' has a script to check that the default values are consistent wrt what is in the code
  • dropped the idea of using the dirac.cfg for autoritative source for the /Systems section of the CS, will keep the rest
  • stitching the /System section in dirac.cfg can probably be done at doc time

DB12:

  • NTR

Release planning, tests and certification

Release planning:

  • v6r20 series
    • NTR
  • v7r0 series
    • the list of feature request is already closed
    • Chris push for a "fast release"... it will be hard!
    • Starting testing in September

Certification process

  • v7r0 certification:
    • NTR
  • https://jenkins-dirac.web.cern.ch/ is open to registrations for who needs it or wants it
    • 3 devs using it
    • M2Crypto development can use that too

Weekly development(s) focus

HTTPS in DIRAC:

  • presentation from Luis (see attached)
  • proof of concept based on an implementation of the CS server serving via HTTPS and tornado-based
  • It's possible and there are advantages
  • already performant, but with python3 it should be much better supported (aSync IOLoop)
  • list of tasks in LHCb Jira
  • some preparation is needed and already possible
  • long term plan
  • M2Crypto is necessary

DIRAC: current PRs and tasks being worked on, or topics from Google forum

  • NTR

DIRAC communities roundtable

  • BES: 
    • NTR
  • CLIC:
    • NTR
  • LHCb: 
    • Moved to v6r20 2 weeks ago
    • Issues with DIRAC SSH CEs solved.
  • GridPP:
    • NTR

AOB

  • Next DIRAC Users Workshop: Daniela is trying to secure a room to potentially hold the next DIRAC Users Workshop in London. Possible dates: week of 13 of May 2019
    • asked if possible to pay 80 GBP -- should be OK
  • Next BiLD-Dev meeting will be held in 4 weeks

LHCbDIRAC

  • v9r3 plan in the wiki
    • possible to deploy in September?
There are minutes attached to this event. Show them.
    • 10:00 10:10
      Items from Previous BiLD-Dev 10m
    • 10:10 10:25
      Current situation 15m

      General remarks

      • DIRAC 3m
      • WebApp 2m
      • Pilot 2m
      • Externals + lcgBundle 2m
      • DIRACOS 2m
      • Documentation 2m
      • pyGSI, Rest, DB12, BOINC 2m
    • 10:25 10:40
      Release planning, tests and certification 15m
    • 10:40 11:00
      Weekly development(s) focus 20m

      HTTPS in DIRAC: updates

      Speaker: Louis Martin (Université Clermont Auvergne (FR))
    • 11:00 11:10
      DIRAC: current PRs and tasks being worked on 10m

      Ongoing PRs
      - v6r20 PR
      Ongoing tasks
      - ?
      Topics from the google forum
      - ?

    • 11:10 11:20
      DIRAC Communities roundtable 10m
    • 11:20 11:30
      AOB
      Convener: Federico Stagni (CERN)
    • 11:30 11:45
      LHCbDIRAC 15m