BiLD-Dev

→ Europe/Zurich
2-R-014 (CERN)

2-R-014

CERN

Federico Stagni (Conseil Europeen Recherche Nucl. (CERN)-Unknown-Unknown)
Description
Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

Bi-weekly DIRAC Development meeting -- 01/08/2019

 

At CERN: Federico, Zoltan, Christophe, Andre', Christopher, Sasha
On Vidyo: Luisa, Hideki

Apologies: 

 

Follow-up from previous meeting

  • GS DOCS: we didn't get any technical writer :/
  • Added linter for JS for WebApp
  • DIRACOS extension: now possible (for python packages), tested within LHCb

DIRAC communities roundtable

  • CLIC:
    • NTR
  • LHCb:
    • NTR
  • CTA:
    • NTR
  • Belle2:
    • Started investigating for using ElasticSearch

Current situation

DIRAC

  • v6r21:
    • Minor fixes only
  • v6r22:
    • v6r22p2 and v6r22p3 created
      • new PilotManager service: changed the port from 9129 to 9171
      • Fixes for MP jobs

VM:

  • Being tried out by GridPP

WebApp:

  • v4r0p7 is the latest release
    • 2 PRs with fixes for v4r0 series
  • Created branch rel-v4r1
    • for v7r1

Pilot3:

  • Discussion in PR for MultiProcessor handling (not MultiLauchAgent)
  • Integration test for PilotLogger is set up
    • VM with tornado that sends messages to CERN ActiveMQ instance
    • Right now works only with python 2.7, plan to use system calls for python 2.6

DIRACOS:

  • Can now be extended (master version)

Documentation

  • Removed some doc for old service (MPIService)
  • Added Aug8 by Andre: Enabled rel-v7r0, rel-v6r22 in dirac.readthedocs.org. Which old versions can be suppressed (rel-v6r17, rel-v6r19 ?)

OAuth2:

  • Will be used from DIRAC v7r1

DB12:

  • NTR

tornado and other externals

  • NTR

Release planning, tests and certification

Release planning:

  • v6r21 series
    • 2 PRs with fixes ready to be merged
      • 1 is for using the DPM "dome" release in case it does not have SRM
    • Discussed PR $4171, related to issue #4168 (ArchiveFiles operation)
      • only a new type of operation
      • suggested to ask on the forum if anyone else wants to add to the discussion
      • it could be merged if "un-drafted"
  • v6r22 series
    • PR #4181 is necessary
    • other PRs only for doc and test
  • v7r0 series
    • v7r0-pre19 tested in the last hackathon
    • generated several PRs that can all be merged (we looked briefly into them during the meeting)
  • v7r1 series
    • We decided to run with the M2Crypto flag on
      • first in Jenkins [Chris to enable it]
    • #4166 (initial support for MySQL 8) can be merged in it
    • No need to add more things in the release
  • Integration (and v7r2)
    • Work of the GSoC students (PRs #4120, #4121, #4158) can all be reviewed and merged in integration
    • JSON (de)serialization (will fail and fall back)

Certification process: 

  • Next week (August 8) hackathon of v7r0-pre20
    • Federico won't be there, Chris will start it
    • This might be the last hackathon needed for v7r0
      • If this won't be the last, emergency hackathon on August 14, in the afternoon
  • August 22: first hackathon of v7r1
    • developers MUST be there

Weekly development(s) focus

  • Just discussed medium/long term releases planning

DIRAC: current PRs and tasks being worked on, or topics from Google forum

  • PR #4179 (GitlabCI pipeline) can be merged as soon as we have time to look into it. Maybe in v7r1
  • PRs #4103 and #4108 needs update from the developers

AOB

NTR

 

 

Next BiLD in 2 weeks from now.

 

---------------------------------------------------------------------------------------------------------------

LHCb

  • v9r4
    • third (and last) hackathon tomorrow
    • needs DIRAC v6r22p4
There are minutes attached to this event. Show them.
    • 10:00 → 10:10
      Items from Previous BiLD-Dev 10m
    • 10:10 → 10:20
      DIRAC Communities roundtable 10m
    • 10:20 → 10:35
      Current situation 15m

      General remarks

      • DIRAC 3m
      • WebApp 2m
      • Pilot 2m
      • DIRACOS 2m
      • Documentation 2m
      • OAuth2 2m
      • tornado, M2Crypto, other externals 2m
    • 10:35 → 10:50
      Release planning, tests and certification 15m
    • 10:50 → 11:10
      Weekly development(s) focus 20m
    • 11:10 → 11:20
      DIRAC: current PRs and tasks being worked on 10m

      Ongoing PRs
      - v6r21 PR
      Ongoing tasks
      - ?
      Topics from the google forum
      - ?

    • 11:20 → 11:30
      AOB
      Convener: Federico Stagni (CERN)
    • 11:30 → 11:45
      LHCbDIRAC 15m