Rucio Development Meeting

Thursday 11 Mar 2021, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

15:00 → 15:10 News

• Rucio 1.26.0 "Donkey League of La Mancha" feature release planning next week
• Google Summer of Code
  • CERN-HSF got accepted as a mentoring organisation
  • 2 Rucio projects submitted
  • Evaluation phase of students until March 25th (Very short)
• CERN Summer student program
  • Selection phase also just started
• 1.25.0rc2
  • Second release candidate released due to an issue with the transfertool filtering
  • Final planned for Monday

15:10 → 15:20 Community News & DevOps roundtable

• RAL
  • No news
• ATLAS
  • Cleaning up RSE attributes
  • FTS ATLAS upgrade next week (Expected 6h downtime)
    • Deployment of new major release 3.10
  • A few nodes still on python2 (Nagios + Auth)
• CMS
  • No news, all quiet
• Fermilab
  • Getting OpenShift deployment done
• Belle II
  • No news
• LDMX
  • No news
• DUNE/Edinburgh
  • New lfn2pfn algorithm in development
  • New metadata catalog (metacat)
  • Lightweight client
    • Keep tabulate
    • Remove progressbar
• ESCAPE
  • Dark data cleanup
  • Planning for the next milestone 
  • Possible new initiative with Rucio
    • Automatix, BB8, Probes, etc.
• SKA
  • Prototype deployment running
    • Fixing Reaper2 issues
    • Hermes2 daemon pushing both to elastic and influx
    • Populating grafana dashboards; Also using Belle2 dashboards
  • Future work
    • Data ingestion usecases
    • Working on policy packages
    • Metadata
    • Also look into probes

15:20 → 15:35 Component discussion: Probes

Speaker: Dimitrios Christidis (University of Texas at Arlington (US))

2021.03.11 Rucio Probes: Contribution Guide.pdf

15:35 → 15:55 Developers roundtable

• Parallel auto-testing
  • PR Ready, should probably be merged first for 1.26 devel
• Integration testing
  • Wrote some more tests for the UploadClient
  • Could also run in parallel
  • New Issue for this please
• For next week: RSE Attributes vs RSE Settings (vs. RSE Limits?)
• Documentation
  • K8s tutorial added to PR
  • API/FLASK generation handed over to Ben
    • Ben looking into it
•  

15:55 → 16:00 AOB