Bi-weekly DIRAC Development meeting -- 28/11/2019

At CERN: Federico, Zoltan, Christophe, Alexandre, Andre', Marko, Christopher
On Vidyo: Xiaomei, Ueda, Hideki, Yugi, Daniela

Apologies: Andrei

Follow-up from previous meeting

• Marko will check (and contact Andrei) on how to use GitHub releases for announcing new releases (no -pre)
• no follow up for payload isolation issues and discussions, will come up again.

DIRAC communities roundtable

• CLIC:
  • FTS: opened connections triggered this PR: https://github.com/DIRACGrid/DIRAC/pull/4334 which was merged in v6r22p15
    • Wiki to be opened for this possible change in bashrc
      • Created issue https://github.com/DIRACGrid/DIRAC/issues/4351 (not specific to CLIC...)
• LHCb:
  • NTR
• Belle2:
  • Still running with v6r21. Trying r22 in the coming weeks
  • looking at python 3 compatibility
• FranceGrilles:
  • Moved to v7r0, but still sending Pilot2 7 weeks ago
    • M2Crypto flag off, will be turned on
  • Asked Lyon T1 to start a ElasticSearch service
• Juno+Bes3
  • interested in AAI, Indigo IAM interaction
• GridPP
  • NTR

Current situation

DIRAC

• v6r22:
  • Mostly fixes, beware of possible new option to set in server bashrc (see release notes)
• v7r0:
  • Last tag v7r0p5 created.
    • more logic for MP jobs, e.g. for partitioning many-core nodes with PoolCE
• v7r1:
  • NTR
• v7r2:
  • NTR

VM:

• just doc update

WebApp:

• new PR with 2 new pages:
  • Downtime calendar (connected to RSS)
  • Space occupancy (table for showing the SE occupancy, also taken from RSS)

Pilot3:

• pilot logging: ongoing work

DIRACOS:

• NTR

Documentation

• fixes for extension

OAuth2:

• NTR

tornado and other externals

• JSON encoding PR "ready", but this is just a first step
• several new issues added to github for fixing code in several parts

Release planning, tests and certification

Release planning:

• v6r22 series
  • few simple PRs ready to be merged
• v7r0 series
  • MP fixes
  • backporting of docker tests should be cherry-picked
• v7r1 series
  • NTR
• Integration (and v7r2)
  • MultiVO DFC PR: need last review from Zoltan

Certification process: 

• NTR

Weekly development(s) focus

CHEP over, some impressions:

• VOMS -> INDIGO IAM in WLCG
  • DIRAC will need to take care, in 2020
  • test instances already out for INDIGO IAM
    • dteam? if there we can start thinking about using it in DIRAC certification (not too soon...)
• interaction with CRIC will be added
• HPCs and DIRAC:
  • pilot scheduling
  • matching, also for new architectures

DIRAC: current PRs and tasks being worked on, or topics from Google forum

• some comments added directly in PRs
• GitHubActions checks backported to v7r0: will be finalized tomorrow
• after we can start merging several PRs
• Chris will doom the SEPrefix (https://github.com/DIRACGrid/DIRAC/issues/4227) as there were no replies to the ticket.

AOB

Next DUW at KEK, 25-29 May 2020. Registration not yet open: fee is not yet finalized.

Next BiLD in 2 weeks from now.

---------------------------------------------------------------------------------------------------------------

LHCb

• https://docs.google.com/document/d/1U4DR-n7Omv4oKOmUaqvXkCTazsgGJG1ybfZYmat8Z9Y/edit?ts=5d8241f4
  • document with a collection of operations, mostly for DB
  • Oracle will also need to be updated, maybe later
    • unclear what are the IT plans
  • In the meantime: migrate slowly all our voboxes to CentOS7, with v6r22+DIRACOS
    • Chris: started re-shuffling the puppet templates
  • A new VM for testing VMDIRAC is needed
• Deployment: we can start the new way to deploy to CVMFS also production releases, in parallel with the old one (which will keep being the default)
  • full switch from v10r0
• LHCbDIRAC docker container: PR created, OK to support such client, need to agree where to store it (docker hub? lhcb nexus repo?)
• LHCbDIRAC v10r0:
  • Hackathon next week, Thursday at 10
    • need to verify especially the BKK web interface