At CERN: Federico, Christophe, Raja, Andre', Marko, Zoltan, Philippe, Joel
On Vidyo: Ueda, Milosz, Luisa, Xiaomei, Simon, Daniela, Andrew

Apologies: 

Follow-up from previous meeting

• (from previous-previous meeting) Move to JSON as serialization
  • a PR made, but broken. Developer left, we asked him to made it better, no answer
•  

Current situation

DIRAC:

• v6r17p32 is the last production version
• v6r19-pre11 is out
  • Should fix the problems with RSS
    • Fully re-implemented also ResourceStatusDB\
  • Using externals v6r6p3 and lcgBundle v13r0
  • v6r19 should be out ASAP

WebApp:

• Zoltan is working on how to ship, using dirac-distribution, the entire Web framework, which right now requires additional deployment steps
  • Possibly using installation packages defined outside of WebAppDIRAC itself
  • This is a necessary step before moving to ExtJS 6

Pilot:

• Need to modify the synchronizer to create (also) a tarball of the pilot files, which should be downloaded then by the pilot wrapper (not using wget which may not be on CC7)
• We can introduce Pilot3 as optional from the SiteDirectors from next version

Externals:

• v6r6p3 still the latest (for v6r19) for both SLC6 and CC7

LCG bundles:

• New Version v13r0 compiled, it will be in testing with DIRAC v6r19 pre versions
  • CC7 version, contrary to what we hoped for long, will NOT be OK (see below)
  • librarians of GFAL2 won't make a static build, so as of today we are stuck on using the system libraries.
  • This version includes python packages like pyparsing and futures, which should be anyway in the externals. To verify
  • Issues with arc with v12r8 to be verified for v13r0
• lcgBundle creation should be moved to github [Joel]
  • Simple list of packages (RPMs) included in a file
  • Instructions and deployment tools should be added to the git repo too
  • Tests should be added to it too
  • other VOs if they want they can extend the package too

BOINC:

• NTR, but in LHCb we are producing quite some documentation for its use

PyGSI:

• NTR

Release planning, tests and certification

Release planning:

• v6r17 series
  • NTR
• v6r19 series
  • Should be out ASAP
    • We'll also create the rel-v6r19 branch just after
  • Due to lcgBundle issues, we won't assure any working version for CC7

Certification process: 

• Certification is ongoing: https://trello.com/b/XpFoYDM6/v6r19-pre12
  • Using trello and slack as usual

Weekly development(s) focus

• move towards CC7:
  • we can't certify anything right now
  • (newer) versions of GFAL2 assume that system libraries are present
    • e.g. boost, but we can't assure that
    • things are working on SLC6, not on CC7
  •  the only real solution would be to do a static build (statically linking of libraries) of GFAL2 and possibly of other packages
    • need to re-compile really everything
    • apparently this is what CMS is doing already
    • followed discussion on how to move forward. SFT is not willing to create static builds, so we are stuck with a "do it ourselves" solution, on which right now we don't want to progress
  • Using our own python with a different encoding is making things worse, in this matter
    • But at the same time we can't afford to use the system python, which might be 2.6 version 

DIRAC: current PRs and tasks being worked on

• pyGSI -> M2Crypto
  • Added proxy delegation
  • Need proper testing, including interaction between different versions of DIRAC
  • Somewhat connected: FTS3 library ships also M2Cripto library

AOB

• RFC proxies are not yet the default in v6r17, while there's no reason why they should not be
  • Then we can remove old legacy code in future version
• TranformationDB on cluster (MariaDB galera cluster with 3 nodes)
  • triple increase of auto-increment: to be verified
• How do users submit jobs?
  • LHCb: Ganga, mostly
  • Some users of GridPP also use ganga
  • ILC: docs are provided to submit jobs directly via DIRAC
    • Trying now parametric jobs
  • BES3: some with Ganga
    • Also trying our parametric jobs
  • Belle2: directly via DIRAC, in extension we provide some script to facilitate their work
  • CTA: directly DIRAC, docs provided
  • Chris suggests to use ipython notebook
• Next BiLD-Dev meeting will be held in 2 weeks (October 12)

LHCbDIRAC

• All tasks for migration out of lb-run have been added to https://its.cern.ch/jira/browse/LBCORE-1410
• Few more points from today:
  • lb-run should always be called from an environment that is clean (saved within the pilot just after lbLogin)
  • Ganga should always call -c best
  • We should remove X509 variables from the environment file that is created.
  • Pilots should set CMTConfig for setting up DIRAC in a CC7 environment (this is urgent)
• We decided that for the moment we stop releasing for CC7 (from v9r0) until we have a working solution
  • After that we should put lb-run -c best in the pilot (it should be tested if it works)