BiLD-Dev

Europe/Zurich
2-R-014 (CERN)

2-R-014

CERN

Federico Stagni (Conseil Europeen Recherche Nucl. (CERN)-Unknown-Unknown)
Description
Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

At CERN: Federico, Zoltan, Christophe, Andre', Vladimir, Raja
On Vidyo: Hideki, Daniela, Simon, Andrei, Marcelo

Apologies: Wojciech

Follow-up from previous meeting

  • Found FD leak and fixed in v6r20p25

DIRAC communities roundtable

  • CLIC:
    • NTR
  • LHCb:
    • NTR
  • GridPP:
    • NTR
  • Belle2:
    • Still running very old v6r17
      • going to upgrade soon (early next year) to v6r20

Current situation

DIRAC

  • v6r20p25 latest production release
    • Fixes for Tags matching (today's focus)
    • Fix FDs leak
    • Variable $DIRAC_DEPRECATED_FAIL can be added to CI tests of extensions

WebApp:

  • v3r1 (for v6r20):
    •  added possibility to specify a personalized welcome page
  • v4r0 PRs all merged. Some issues with deploy should be fixed with latest fixes

Pilot3:

  • Wojtek (by mail):
  • alpha prototype for server for pilots logging:
    1. Tornado checks if certificate DN is on a list of authorized DNs
    2. if yes it receives a  message via Tornado REST API and pass it to a stomp producer which sends it to a MQ
    What is still not finished is the synchronization with DIRAC.

DIRACOS:

  • Some devel libraries put back
  • added MySQL client
  • DIRACOS v1r0 should be ready, tag soon

Documentation

  • website diracgrid.org
    • No progress in the last 2 weeks

BOINC:

  • NTR

DB12:

  • NTR

tornado and other externals

  • Simon made a PR on Chris repository concerning M2Crypto, still to be evaluated

Release planning, tests and certification

Release planning:

  • v6r20 series
    • NTR
  • v7r0 series
    • Last PRs all merged
    • Should install on DIRAC certification with:
      • DIRAC v7r0-preX
      • DIRACOS  v1r0
      • WebApp 4.0
      • releases.cfg should be modified accordingly
      • need to see where's the DB!
    • bashrc will need to be re-done, so a fresh installation is needed
      • Instructions should go to https://github.com/DIRACGrid/DIRAC/wiki/DIRAC-v7r0
    • All Jenkins tests should be updated

Certification process

  • NTR

Weekly development(s) focus

  • Tags and MultiProcessor jobs
    • Added some fixes for the use of Tag. The use case is for MultiProcessor jobs but the fixes are totally generic
    • Discussion points to an "institutionalization" of how to do multiprocessing
      • e.g. the "MultiProcessor" tag should be "hidden", or maybe automatically created
      • the users should not need to know which tags to set (so maybe change the API, e.g. add a "setMultiProcessor()"?)
      • The BDII2CSAgent may also need to be updated to see if tags could be added
    • Also added some explanation within the documentation
      • should be changed to "how to use tags" in a generic way
      • the use cases in there are real

DIRAC: current PRs and tasks being worked on, or topics from Google forum

  • Pilot: need to check if PYTHONPATH is set or not, do NOT pick it up
    • in this respect, let's not change the bashrc created by dirac-install

AOB

  • Next BiLD-Dev meeting will be held in 5 weeks (17 January first meeting of the year)

LHCbDIRAC

  • v9r3 and v9r4 plan in the wiki
  • CVMFS installation of lcgBundle:
    • need to remove the setting of the PYTHONPATH
    • we need instructions to be added so that everyone can release
    • all tasks in https://its.cern.ch/jira/browse/LBCORE-1410
  • v9r4 plan in the wiki
    • One more release based on v6r20 with many LHCbDIRAC things
There are minutes attached to this event. Show them.
    • 10:00 10:10
      Items from Previous BiLD-Dev 10m
    • 10:10 10:20
      DIRAC Communities roundtable 10m
    • 10:20 10:35
      Current situation 15m

      General remarks

      • DIRAC 3m
      • WebApp 2m
      • Pilot 2m
      • DIRACOS 2m
      • Documentation 2m
      • DB12, BOINC 2m
      • tornado, M2Crypto, other externals 2m
    • 10:35 10:50
      Release planning, tests and certification 15m
    • 10:50 11:10
      Weekly development(s) focus 20m

      On MP jobs

    • 11:10 11:20
      DIRAC: current PRs and tasks being worked on 10m

      Ongoing PRs
      - v6r20 PR
      Ongoing tasks
      - ?
      Topics from the google forum
      - ?

    • 11:20 11:30
      AOB
      Convener: Federico Stagni (CERN)
    • 11:30 11:45
      LHCbDIRAC 15m