BiLD-Dev

Name: BiLD-Dev
Start: 2018-11-15T10:00:00+01:00
End: 2018-11-15T11:45:00+01:00
Location: CERN

Thursday 15 Nov 2018, 10:00 → 11:45 Europe/Zurich

2-R-014 (CERN)

Federico Stagni (Conseil Europeen Recherche Nucl. (CERN)-Unknown-Unknown)

Description

Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

Hide

At CERN: Federico, Zoltan, Marko, Andre', Vladimir
On Vidyo: Daniela, Andrei, Raja, Marcelo

Apologies: Chistophe, Wojtek, Xiaomei

Follow-up from previous meeting

DIRAC communities roundtable

CLIC:
- NTR
LHCb:
- Working on a LHCbDIRAC release still based on v6r20
  - Parametric jobs
  - Better platform selection
  - MP queues
- ECHO SE working in production as Failover SE, profiting of the latest DIRAC release
- Logs aggregation via MQ and LogStash
  - in production for LHCb Optimizers
  - For the moment, not much more than collecting all logs in one file, on a dedicated machine
  - Grepping/searching still left to users
  - using ActiveMQ at CERN as one of the logs backends
    - Minimal configuration in the CS
- LHCb BOINC closed
  - too much hassle for too little results
GridPP:
- Migrating T2K from LFC to DFC
  - Using tape at RAL (Castor)
  - Not yet managed to use, probably just need to install Storage Management System
Virgo:
- First tutorial last week - promising new client
EGI
- Struggling with incorporation of SSO
  - Portal updated to incorporate SSO (PR for WebApp)
  - Looking into converting SSO token -> X509 proxy
    - Several open questions still to solve, like VOMS roles
  - Once done, users will not need to manage certificates themselves
    - Proxies will be created on the fly
  - External service, provided by EGI, will need to be make to work with DIRAC

Current situation

DIRAC

v6r20p20 latest production release
- TaskQueue selection changes: introduced wildcard "ANY" for every matching parameter
- can do e.g. "python -m pytest dirac-* " and correctly parse arguments to the DIRAC script

WebApp:

3 PRs:
- 302: for v3r1, can be merged now
- 282: for v4r0 (branch integration) and should probably be merged now together with DIRAC v7r0
- 303: created for current version of integration, but will need to be updated (re-done?) once 282 will be merged

Pilot3:

Jenkins tests for master branch now working, devel not (to be checked)
Wojtek restarted work on pilots logging together with a new student
- Pilot itself is fine, the server is being prototyped right now as a tornado web app

DIRACOS:

Broken links fixes
- there's a "white list" of broken links, the others are fixed
500MB of bundle
- Looking for slimming it down
- CVMFS deployment is the way to go
Fedora: still tests not working, maybe to pre-load some SELinux
CVMFS and hard links across directories would not work: solved

Documentation

website diracgrid.org
- No progress in the last 2 weeks
PR for cfg file in readthedocs:
- the dirac.cfg should be created here https://dirac.readthedocs.io/en/integration/AdministratorGuide/Configuration/ExampleConfig.html but it appears to be broken right now

BOINC:

DB12:

tornado and other externals

Release planning, tests and certification

Release planning:

v6r20 series
- NTR
v7r0 series
- Many PRs merged
- Last PRs in the pipeline (dirac-install++ and ProductionSystem)
  - dirac-install++: few more issues, need to create a good integration test for different python versions
  - ProductionSystem: a couple more comments in the review.

Certification process:

Weekly development(s) focus

NTR

DIRAC: current PRs and tasks being worked on, or topics from Google forum

NTR

AOB

LHCbDIRAC

v9r3 plan in the wiki
- some things maybe will not make it for this release -- wiki updated
Plan to release on December 3 (2 full weeks from now)
lcgBundle deployment on CVMFS
- Joel started, not clear what's the status
Separated CS of certification from the one of production, looks OK

There are minutes attached to this event. Show them.