BiLD-Dev

→ Europe/Zurich
2-R-014 (CERN)

2-R-014

CERN

Federico Stagni (Conseil Europeen Recherche Nucl. (CERN)-Unknown-Unknown)
Description
Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

Bi-weekly DIRAC Development meeting -- 15/08/2019

 

At CERN: Federico, Zoltan, Alexandre, Andre', Christopher, Sasha
On Vidyo: Simon

Apologies: Andrei

 

Follow-up from previous meeting

  •  

DIRAC communities roundtable

  • CLIC:
    • NTR
  • LHCb:
    • Moved to v6r22
      • no problems up to now
  • GridPP:
    • NTR

Current situation

DIRAC

  • v6r21:
    • Added ArchiveFiles operation
  • v6r22:
    • v6r22p5 created
      • Minor fixes only
  • v7r0 and v7r1:
    • new pre-releases created

VM:

  • NTR

WebApp:

  • More fixes for v4r0
  • A few fixes added now that it's in production for LHCb

Pilot3:

  • Discussion in PR for MultiProcessor handling (not MultiLauchAgent) still going on

DIRACOS:

  • Can now be extended (master version), one more fix for the location of the tarball is to be merged

Documentation

  • dirac.readthedocs.org: old versions can be suppressed (rel-v6r17, rel-v6r19)\
  • ads are coming on readthedocs

OAuth2:

  • NTR

DB12:

  • NTR

tornado and other externals

  • NTR

Release planning, tests and certification

Release planning:

  • v6r21 series
    • NTR
  • v6r22 series
    • PR #4205 contains the possibility to let the SiteDirectors send accounting info for the Pilot submission
      • should be monitoring, not accounting
        • can probably anyway be merged
      • should have a flag to disable it
  • v7r0 series
    • v7r0-pre21 tested in the last hackathon
      • didn't show errors, but subsequest tests prove that the pilot wrapper can't run on Python 2.6 nor on 2.7+, so release could not be announced (fixes still being prepared by Federico)
      • new pre-release created anyway
  • v7r1 series
    • We decided to run with the M2Crypto flag on
    • initial support for MySQL 8 has been merged in it
    • No need to add more things in the release
  • Integration (and v7r2)
    • Work of the GSoC students can all be reviewed and merged in integration (partly done)
    • JSON (de)serialization (will fail and fall back)

Certification process: 

  • Next week (August 22) hackathon of v7r0-preX
    • Should be the last hackathon needed for v7r0
      • should use the ES for Job Parameters
  • August 29: first hackathon of v7r1
    • developers of OAuth2 MUST be there

Weekly development(s) focus

  • NTR

DIRAC: current PRs and tasks being worked on, or topics from Google forum

  • PR #4179 (GitlabCI pipeline) can be merged as soon as we have time to look into it. Maybe in v7r1
  • autopep8 probably too aggressive
    • BaseException -> Exception

AOB

Next BiLD in 4 weeks from now

 

---------------------------------------------------------------------------------------------------------------

LHCb

  • v9r4 is out
    • pretty smoothly
    • can create patch and deploy it on Monday (Web and BKK)
    • Pilot versions: v9r4 and v9r3p9 allowed now
      • we should removed v9r3p9
      • on Monday allow the containers (gaudirun flag)
        • up to that, e.g. Zurich can't run any job
        • per-site options also needed
  • v9r5:
    • can probably be based on v7r0, and renamed v10r0
    • list of features can stay
There are minutes attached to this event. Show them.
    • 10:00 → 10:10
      Items from Previous BiLD-Dev 10m
    • 10:10 → 10:20
      DIRAC Communities roundtable 10m
    • 10:20 → 10:35
      Current situation 15m

      General remarks

      • DIRAC 3m
      • WebApp 2m
      • Pilot 2m
      • DIRACOS 2m
      • Documentation 2m
      • OAuth2 2m
      • tornado, M2Crypto, other externals 2m
    • 10:35 → 10:50
      Release planning, tests and certification 15m
    • 10:50 → 11:10
      Weekly development(s) focus 20m
    • 11:10 → 11:20
      DIRAC: current PRs and tasks being worked on 10m

      Ongoing PRs
      - v6r21 PRs
      - v6r22 PRs
      - v7r0 PRs
      - v7r1 PRs
      Ongoing tasks
      - ?
      Topics from the google forum
      - ?

    • 11:20 → 11:30
      AOB
      Convener: Federico Stagni (CERN)
    • 11:30 → 11:45
      LHCbDIRAC 15m