Bi-weekly DIRAC Development meeting -- 15/08/2019

At CERN: Federico, Zoltan, Alexandre, Andre', Christopher, Sasha
On Vidyo: Simon

Apologies: Andrei

Follow-up from previous meeting

DIRAC communities roundtable

• CLIC:
  • NTR
• LHCb:
  • Moved to v6r22
    • no problems up to now
• GridPP:
  • NTR

Current situation

DIRAC

• v6r21:
  • Added ArchiveFiles operation
• v6r22:
  • v6r22p5 created
    • Minor fixes only
• v7r0 and v7r1:
  • new pre-releases created

VM:

• NTR

WebApp:

• More fixes for v4r0
• A few fixes added now that it's in production for LHCb

Pilot3:

• Discussion in PR for MultiProcessor handling (not MultiLauchAgent) still going on

DIRACOS:

• Can now be extended (master version), one more fix for the location of the tarball is to be merged

Documentation

• dirac.readthedocs.org: old versions can be suppressed (rel-v6r17, rel-v6r19)\
• ads are coming on readthedocs

OAuth2:

• NTR

DB12:

• NTR

tornado and other externals

• NTR

Release planning, tests and certification

Release planning:

• v6r21 series
  • NTR
• v6r22 series
  • PR #4205 contains the possibility to let the SiteDirectors send accounting info for the Pilot submission
    • should be monitoring, not accounting
      • can probably anyway be merged
    • should have a flag to disable it
• v7r0 series
  • v7r0-pre21 tested in the last hackathon
    • didn't show errors, but subsequest tests prove that the pilot wrapper can't run on Python 2.6 nor on 2.7+, so release could not be announced (fixes still being prepared by Federico)
    • new pre-release created anyway
• v7r1 series
  • We decided to run with the M2Crypto flag on
  • initial support for MySQL 8 has been merged in it
  • No need to add more things in the release
• Integration (and v7r2)
  • Work of the GSoC students can all be reviewed and merged in integration (partly done)
  • JSON (de)serialization (will fail and fall back)

Certification process: 

• Next week (August 22) hackathon of v7r0-preX
  • Should be the last hackathon needed for v7r0
    • should use the ES for Job Parameters
• August 29: first hackathon of v7r1
  • developers of OAuth2 MUST be there

Weekly development(s) focus

• NTR

DIRAC: current PRs and tasks being worked on, or topics from Google forum

• PR #4179 (GitlabCI pipeline) can be merged as soon as we have time to look into it. Maybe in v7r1
• autopep8 probably too aggressive
  • BaseException -> Exception

AOB

Next BiLD in 4 weeks from now

---------------------------------------------------------------------------------------------------------------

LHCb

• v9r4 is out
  • pretty smoothly
  • can create patch and deploy it on Monday (Web and BKK)
  • Pilot versions: v9r4 and v9r3p9 allowed now
    • we should removed v9r3p9
    • on Monday allow the containers (gaudirun flag)
      • up to that, e.g. Zurich can't run any job
      • per-site options also needed
• v9r5:
  • can probably be based on v7r0, and renamed v10r0
  • list of features can stay