Bi-weekly DIRAC Development meeting -- 01/08/2019

At CERN: Federico, Zoltan, Christophe, Andre', Christopher, Sasha
On Vidyo: Luisa, Hideki

Apologies: 

Follow-up from previous meeting

• GS DOCS: we didn't get any technical writer :/
• Added linter for JS for WebApp
• DIRACOS extension: now possible (for python packages), tested within LHCb

DIRAC communities roundtable

• CLIC:
  • NTR
• LHCb:
  • NTR
• CTA:
  • NTR
• Belle2:
  • Started investigating for using ElasticSearch

Current situation

DIRAC

• v6r21:
  • Minor fixes only
• v6r22:
  • v6r22p2 and v6r22p3 created
    • new PilotManager service: changed the port from 9129 to 9171
    • Fixes for MP jobs

VM:

• Being tried out by GridPP

WebApp:

• v4r0p7 is the latest release
  • 2 PRs with fixes for v4r0 series
• Created branch rel-v4r1
  • for v7r1

Pilot3:

• Discussion in PR for MultiProcessor handling (not MultiLauchAgent)
• Integration test for PilotLogger is set up
  • VM with tornado that sends messages to CERN ActiveMQ instance
  • Right now works only with python 2.7, plan to use system calls for python 2.6

DIRACOS:

• Can now be extended (master version)

Documentation

• Removed some doc for old service (MPIService)
• Added Aug8 by Andre: Enabled rel-v7r0, rel-v6r22 in dirac.readthedocs.org. Which old versions can be suppressed (rel-v6r17, rel-v6r19 ?)

OAuth2:

• Will be used from DIRAC v7r1

DB12:

• NTR

tornado and other externals

• NTR

Release planning, tests and certification

Release planning:

• v6r21 series
  • 2 PRs with fixes ready to be merged
    • 1 is for using the DPM "dome" release in case it does not have SRM
  • Discussed PR $4171, related to issue #4168 (ArchiveFiles operation)
    • only a new type of operation
    • suggested to ask on the forum if anyone else wants to add to the discussion
    • it could be merged if "un-drafted"
• v6r22 series
  • PR #4181 is necessary
  • other PRs only for doc and test
• v7r0 series
  • v7r0-pre19 tested in the last hackathon
  • generated several PRs that can all be merged (we looked briefly into them during the meeting)
• v7r1 series
  • We decided to run with the M2Crypto flag on
    • first in Jenkins [Chris to enable it]
  • #4166 (initial support for MySQL 8) can be merged in it
  • No need to add more things in the release
• Integration (and v7r2)
  • Work of the GSoC students (PRs #4120, #4121, #4158) can all be reviewed and merged in integration
  • JSON (de)serialization (will fail and fall back)

Certification process: 

• Next week (August 8) hackathon of v7r0-pre20
  • Federico won't be there, Chris will start it
  • This might be the last hackathon needed for v7r0
    • If this won't be the last, emergency hackathon on August 14, in the afternoon
• August 22: first hackathon of v7r1
  • developers MUST be there

Weekly development(s) focus

• Just discussed medium/long term releases planning

DIRAC: current PRs and tasks being worked on, or topics from Google forum

• PR #4179 (GitlabCI pipeline) can be merged as soon as we have time to look into it. Maybe in v7r1
• PRs #4103 and #4108 needs update from the developers

AOB

NTR

Next BiLD in 2 weeks from now.

---------------------------------------------------------------------------------------------------------------

LHCb

• v9r4
  • third (and last) hackathon tomorrow
  • needs DIRAC v6r22p4