At CERN: Federico, Christophe, Philippe, Zoltan, Marko, Hamza, Vladimir, Andre
On Vidyo: Simon, Daniela, Andrei, Ueda, Marcelo

Apologies: Wojtek

Follow-up from previous meeting

• lcgBundle wiki has been updated
• ARC CEs
  • glue2 support still not there [Vladimir to look into it]
  • [Raja + Andrei + Daniela] to look in details

Current situation

DIRAC

• v6r19p13 is still the last production version
  • v6r19p14 is buggy, please wait for v6r19p15 before upgrading
  • problem within the pilot

WebApp:

• The new release procedure of WebApp has been merged, part of v6r20
  • Documentation needs to be updated
  • Tested, looks OK
• Test for moving WebApp to ExtJS6 ongoing, almost finished
  • Will be for 4.0 version of WebAppDIRAC
  • NOT for DIRAC v6r20, later
  • Extensions would need to be adapted
  • Branches like in DIRAC should be introduced also for WebAppDIRAC [Zoltan]

Pilot:

• Wojtek created a PR for pilot logging
  • still want to add more complete integration tests for both REST and MQ cases, to be used together RESTDirac and our MQ components, so keeping the [WIP] flag for this moment.

Externals:

• v6r6p5 created. Used in v6r20
  • updated version of ElasticSearch to 6, and version of most of the other libraries
    • not updated matplotlib and Pillow which require careful testing
  • only for SLC6 for now, so that certification can keep going 
  • at the end it will be also for SL7
• For future: everything that can be installed with pip install should go in "post installation"
  • Andrei looking into it: https://github.com/DIRACGrid/DIRAC/issues/3444
  • maybe need to change the order in which the Externals  and the pip packages are installed.

LCG bundles:

• current production version is v13r0, but 4 or 5 new versions of packages of the Grid middleware are available, so new version of the lcgBundle will come. Also needing new xroot and to re-include LFC support.
• At the previous meeting Daniela reported that they need to add in $PYTHONPATH the path for locally installed packages of python 2.6, and this went into an issue in https://github.com/DIRACGrid/DIRAC/issues/3614
  • The correct solution of this is not so easy
  • in fact it's about re-compiling everything, starting from the source RPMs. This is what is Chris is investigating with high priority.

REST:

• Wojtek will create PRs as soon as possible for:
  • choosing among different authentication methods (OAuth and X509)
  • adding the pilots logging interface
  • Delayed because of issues discovered in the DIRAC stomp interface
  • ...and because of code refurbishment
• The connection with CS-based authZ will be done later
• Tornado proposes some unit/integration tests which look easy to use, and that can be integrated in Travis or Jenkins. Maybe also for WebApp.  

BOINC:

• NTR, docs still need to be completed

PyGSI:

• NTR

Documentation

• NTR

DB12:

• NTR

Release planning, tests and certification

Release planning:

• v6r19 series
  • make v6r19p15 today
• v6r20 series
  • pre14 out
  • contains all the new features, so now it's only about testing
  • lots of code has been removed from WMS, all dealing with gLite WMS
  • Still one week to test.

Certification process: 

• v6r20 certification: 
  • Using trello and slack as usual
  • Some updates as usual

Weekly development(s) focus

• NTR

DIRAC: current PRs and tasks being worked on

• NTR

DIRAC communities roundtable

• GridPP:
  • Some operational and maybe scalability issues with MySQL and services being addressed
• BES: 
  • Looking into using Singularity, pointing to Simon's work
• ILC: NTR
• LHCb: 
  • The update to MySQL version to 5.7 created quite some issues, mostly due to the setup of the CERN Database on Demand. Now we are out of the operational issues, but still we have 2 instances that will need to be migrated.
  • Some fixes needed to be done anyway, mostly for sizing correctly the columns. All changes applied collected in https://github.com/DIRACGrid/DIRAC/wiki/DIRAC-v6r20
• CNAF (Italian Grid DIRAC service):
  • Virgo the main user-to-be
• DIRAC4EGI:
  • Communities starting to flow in
    • including actual support
    • Andrei involved
  • maybe needing an automated procedure to add VOs 
• Belle2:
  • BNL joined the computing. Support from PNNL cut, but PNNL still will use DIRAC for other projects.

AOB

• Next BiLD-Dev meeting will be held in 2 weeks (March 8)

LHCbDIRAC

• We should right now concentrate on testing v6r20
  • Philippe's MR is being rebased, will be then merged straight away
• at most 4 students this summer
  • for 3 of them their project include using ElasticSearch