Bi-weekly DIRAC Development meeting -- 02/05/2019

At CERN: Zoltan, Christophe, Andre', Marko, Marcelo, Vladimir, Chris Burr
On Vidyo: Daniela, Simon, Janusz, Andrei, Andrii

Apologies: Ueda, Wojtek

Follow-up from previous meeting

• Sent application for GS DOCS: https://hepsoftwarefoundation.org/gsdocs/2019/proposal_DIRAC.html
• GSOC answers for students will come on Monday
• SiteDirector fix (originally in https://github.com/DIRACGrid/DIRAC/issues/4014) should be applied to v6r21 too
• DIRAC certification machine has been re-done and started to be used

DIRAC communities roundtable

• CLIC:
  • NTR, not moved yet to v6r21
• LHCb:
  • DIRACOS machine momentarily stopped (update issues, that should be solved by now). It will be restored this week
• GridPP:
  • Janusz asked about using the DFC in a multi-VO scenario, as some issues have been encountered, mostly regarding the metadata part. Led to creation of https://github.com/DIRACGrid/DIRAC/issues/4058
• EGI:
  • installation is the same as some time ago, stable. Working on OAuth2 integration (see later)

Current situation

DIRAC

• v6r21:
  • v6r21p5 is the last patch release
    • added administrator tutorials (will be used to create an image that will be used for the workshop)
    • SiteDirector: restored usage of WaitingToRunning ratio
    • MQ fixes for reconnection
• v6r22-pre1:
  • created for:
    • enabling WebAppDIRAC 4
    • PilotManagerHandler service
    • Better use of Pilot 3
    • Oath2 service (in extension, see later)

VM:

• NTR

WebApp:

• Web 4.0 will need a minor fix for using PilotManagerHandler

Pilot3:

• NTR

DIRACOS:

• NTR

Documentation

• PR for refactoring the scripts for creating the docs is ready to be merged

BOINC:

• NTR

DB12:

• NTR

tornado and other externals

• NTR

Release planning, tests and certification

Release planning:

• v6r21 series
  • NTR
• v6r22 series
  • Jenkins tests to start running
  • pre1 should be put on DIRAC certification machine
    • which is CC7, so use DIRACOS too
• v7r0 series
  • NTR

Certification process: 

• The DIRAC certification machine has been re-done from scratch, with CentOS7

Weekly development(s) focus

Andrii Litovchenko presented the work being done for EGI for integration EGI check-in service and OAuth2. The work is very intereststing, and presents some challenges (see pres attached to the agenda).

The discussion focused on how to interact and integrate HTTPS services in DIRAC. The work presented uses the current webportal for creating a DIRAC OAuth2 service, and proposes to move the base code of WebAppDIRAC to DIRAC. This was felt partly in contrast with what was agreed long time ago and that was added as solution in https://github.com/DIRACGrid/DIRAC/pull/3815.

The agreed solution is:

• close #4055 (so, not adding WebApp files to DIRAC, just leave them there)
• create a new DIRAC extension (e.g. OAuth2DIRAC) where to put the content of #4037 (the new service)
  • this extension would need WebAppDIRAC
• add this extension to v6r22

DIRAC: current PRs and tasks being worked on, or topics from Google forum

• NTR

AOB

- CHEP abstracts: going to submit one for DIRAC, generic

- DUW agenda ready

Next BiLD in 5 weeks from now.

---------------------------------------------------------------------------------------------------------------

LHCb

• Issues with BulkSubmission should be fixed with newest MR
• v9r4 will be based on v6r22 and not v6r21
• The installation instructions might be changed in view of https://github.com/DIRACGrid/DIRAC/pull/4047
• Alias for setting up LHCbDIRAC environment: discussed/agreed in https://its.cern.ch/jira/browse/LBCORE-1420 : no progress yet
  • The lb-run hack/alias will stay for some time