Rucio Development Meeting

Thursday 1 Apr 2021, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

15:00 → 15:10 News

• 1.25.1.post2 hotfix release
  • --nrandom issue
  • Encoding issue in some env
• April Release schedule
  • 1.25.2 - Apr 6
  • 1.25.3 - Apr 19
• Next week: Auditor discussion
• Slides for vCHEP

15:10 → 15:20 Community News & DevOps roundtable

• ATLAS
  • Kronos hostname rotation with 1.25 increased #connections to activemq
    • Need to check, should not resolve against the dns loadbalancer that often
  • Kubernetes loadbalancer issues last week
    • K8s loadbalancer had load issues, CERN IT moved us to another node, things seem to be fine
• CMS
  • Issue with cloqegged queues - Nick prepared a patch
    • Need to integrate this upstream
• Fermilab
  • DUNE and Ikarus deployment preparation
• Belle II
• Edinburgh/DUNE
  • Lightweight client PR updates
  • New lfn2pfn algorithm

15:20 → 15:30 Hot topics

15:30 → 15:55 Developers roundtable

Rucio 1.26 "Donkey League of La Mancha" priority followup

• In Progress
  • Test and switch to new rule algorithm #4215 [Martin]
    • 3 rounds of testing in ATLAS, all fine
    • Switch as default NOW in 1.26
  • Migrate documentation to new docusaurus [Martin, Ben, Daniel]
    • GH Actions
      • API generation (Clients API) works with pydoc-markdown
      • REST API works, but does not look useful
        • OpenAPI might be a good option to solve this
          • Not fully automatical, but should take 1-2 weeks
      • Next week to move/remove files form core repo
  • Logging Review #4220 [All Component leads]
  • Re-Factor Transfer workflow [Radu
    • Small PR submitted, more work needed 
  • Discuss and plan mysql5 deprecation [Mario]
• Todo
  • Test SSO Login [Rizart]
  • Test Import and Export of CRIC JSON [Rizart]
  • Switch to policy-packages as default [James, Martin]
  • Versioned history tables #2063 [Martin]
  • Rename reaper2 to reaper #4462 [Martin]
  • Hermes2 planning
  • rucio.cfg vs Config table #2630 [Mario] 
  • Python 3.8 and 3.9 testing #4453 [Ben]
  • Remove webpy endpoints and dependency #4044 [Ben]
  • Setup.py and requirements overhaul #4456 [Ben]
  • Auditor overhaul #3437 [Dimitrios, Eric] 
  • Cleanup tickets #4463 [*]
• Done
• Delayed
  • QoS #3419 [Mario, Martin, Rizart]

Developer roundtable

• Integration testing
  • FTS container not doing transfers, needs some work
• Testing issue with Deadlocks
  • Still needs a restart from time to time
  • Needs further investigation

15:55 → 16:00 AOB