BiLD-Dev

→ Europe/Zurich
2-R-014 (CERN)

2-R-014

CERN

Federico Stagni (Conseil Europeen Recherche Nucl. (CERN)-Unknown-Unknown)
Description
Bi-Weekly "Loyal" DIRAC developers meeting. And, following, the LHCbDIRAC developers meeting.

Bi-weekly DIRAC Development meeting -- 28/11/2019

 

At CERN: Federico, Zoltan, Christophe, Alexandre, Andre', Marko, Christopher
On Vidyo: Xiaomei, Ueda, Hideki, Yugi, Daniela

Apologies: Andrei

 

Follow-up from previous meeting

  • Marko will check (and contact Andrei) on how to use GitHub releases for announcing new releases (no -pre)
  • no follow up for payload isolation issues and discussions, will come up again.

DIRAC communities roundtable

  • CLIC:
    • FTS: opened connections triggered this PR: https://github.com/DIRACGrid/DIRAC/pull/4334 which was merged in v6r22p15
      • Wiki to be opened for this possible change in bashrc
        • Created issue https://github.com/DIRACGrid/DIRAC/issues/4351 (not specific to CLIC...)
  • LHCb:
    • NTR
  • Belle2:
    • Still running with v6r21. Trying r22 in the coming weeks
    • looking at python 3 compatibility
  • FranceGrilles:
    • Moved to v7r0, but still sending Pilot2 7 weeks ago
      • M2Crypto flag off, will be turned on
    • Asked Lyon T1 to start a ElasticSearch service
  • Juno+Bes3
    • interested in AAI, Indigo IAM interaction
  • GridPP
    • NTR

Current situation

DIRAC

  • v6r22:
    • Mostly fixes, beware of possible new option to set in server bashrc (see release notes)
  • v7r0:
    • Last tag v7r0p5 created.
      • more logic for MP jobs, e.g. for partitioning many-core nodes with PoolCE
  • v7r1:
    • NTR
  • v7r2:
    • NTR

VM:

  • just doc update

WebApp:

  • new PR with 2 new pages:
    • Downtime calendar (connected to RSS)
    • Space occupancy (table for showing the SE occupancy, also taken from RSS)

Pilot3:

  • pilot logging: ongoing work

DIRACOS:

  • NTR

Documentation

  • fixes for extension

OAuth2:

  • NTR

tornado and other externals

  • JSON encoding PR "ready", but this is just a first step
  • several new issues added to github for fixing code in several parts

Release planning, tests and certification

Release planning:

  • v6r22 series
    • few simple PRs ready to be merged
  • v7r0 series
    • MP fixes
    • backporting of docker tests should be cherry-picked
  • v7r1 series
    • NTR
  • Integration (and v7r2)
    • MultiVO DFC PR: need last review from Zoltan

Certification process: 

  • NTR

Weekly development(s) focus

CHEP over, some impressions:

  • VOMS -> INDIGO IAM in WLCG
    • DIRAC will need to take care, in 2020
    • test instances already out for INDIGO IAM
      • dteam? if there we can start thinking about using it in DIRAC certification (not too soon...)
  • interaction with CRIC will be added
  • HPCs and DIRAC:
    • pilot scheduling
    • matching, also for new architectures

DIRAC: current PRs and tasks being worked on, or topics from Google forum

 

  • some comments added directly in PRs
  • GitHubActions checks backported to v7r0: will be finalized tomorrow
  • after we can start merging several PRs
  • Chris will doom the SEPrefix (https://github.com/DIRACGrid/DIRAC/issues/4227) as there were no replies to the ticket.

 

AOB

Next DUW at KEK, 25-29 May 2020. Registration not yet open: fee is not yet finalized.

Next BiLD in 2 weeks from now.

 

---------------------------------------------------------------------------------------------------------------

LHCb

  • https://docs.google.com/document/d/1U4DR-n7Omv4oKOmUaqvXkCTazsgGJG1ybfZYmat8Z9Y/edit?ts=5d8241f4
    • document with a collection of operations, mostly for DB
    • Oracle will also need to be updated, maybe later
      • unclear what are the IT plans
    • In the meantime: migrate slowly all our voboxes to CentOS7, with v6r22+DIRACOS
      • Chris: started re-shuffling the puppet templates
    • A new VM for testing VMDIRAC is needed
  • Deployment: we can start the new way to deploy to CVMFS also production releases, in parallel with the old one (which will keep being the default)
    • full switch from v10r0
  • LHCbDIRAC docker container: PR created, OK to support such client, need to agree where to store it (docker hub? lhcb nexus repo?)
  • LHCbDIRAC v10r0:
    • Hackathon next week, Thursday at 10
      • need to verify especially the BKK web interface
There are minutes attached to this event. Show them.
    • 10:00 → 10:10
      Items from Previous BiLD-Dev 10m
    • 10:10 → 10:20
      DIRAC Communities roundtable 10m
    • 10:20 → 10:35
      Current situation 15m

      General remarks

      • DIRAC 3m
      • WebApp 2m
      • Pilot 2m
      • DIRACOS 2m
      • VMDIRAC 2m
      • Documentation 2m
      • OAuth2 2m
      • tornado, M2Crypto, other externals 2m
    • 10:35 → 10:50
      Release planning, tests and certification 15m
    • 10:50 → 11:10
      Weekly development(s) focus 20m

      CHEP outcome and subsequent tasks:
      - INDIGO IAM
      - CRIC
      - HPCs + non-standard architectures
      - K8S "everywhere"
      - ...?

    • 11:10 → 11:20
      DIRAC: current PRs and tasks being worked on 10m

      Ongoing PRs
      - v6r22 PRs
      - v7r0 PRs
      - v7r1 PRs
      - v7r2 PRs
      Ongoing tasks
      - ?
      Topics from the google forum
      - ?

    • 11:20 → 11:30
      AOB
      Convener: Federico Stagni (CERN)
    • 11:30 → 11:45
      LHCbDIRAC 15m