Rucio Meeting

Thursday 14 Oct 2021, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

1 News

• Thanks for participating to the Rucio Workshop
• Release schedule
  • 1.26.6 October 18
  • 1.26.7 November 1
• Meeting Schedule
  • Oct 14
  • Oct 21
  • Oct 28
• Code review
  • Everyone is welcome to review PRs!
• New technical student @ CERN: Joel

2 Community News & DevOps roundtable

• ATLAS
  • Data Challenge & Tape Challenge
    • Rucio worked well, things worked smoothly
    • Single-file finishing of conveyor
      • Rucio waiting for transfer task to finish in cases of multiple transfers in one job
      • Fix part of 1.26.5
  • Reaper sometimes stops deletion
    • Under investigation, possibly different issues
      • 8000s timeout issue (Some unlink requests just hang forever)
        • Needs to be set to a reasonable value
• CMS
  • Upgrade to 1.26.5
  • FTS jobs not being cancelled when deleting rule
    • Needs investigation
  • WebUI
    • Login issue where you have to force the account, otherwise it tries to authenticated random account
• Fermilab
  • DUNE running 1.26.2 as well
• Belle II
• DUNE/Edinburgh
• DIRAC
  • Alternate Scope extraction algorithm -> Should eliminate need for rucio.cfg on the client (Just by parameters via constructor)
  • PR Ready; Needs review
• MultiVO
  • Running 1.26.2 in containers
  • Server to 1.26 VM has issues
  • Follow up in #support
• ESCAPE
  • Move to 1.26.5/6 next week
  • Experiments preparing DAC21
    • Infrastructure + Data lake as a service
    • Token flow finished
    • Starts Nov22
      • Mock runs the month before
  • Issue with RSEs in IN2P3
    • Mismatch between Rucio occupancy and storage counting

3 Hot topics

4 Developers roundtable

Rucio 1.27 "Batdonkey v. Superdonkey" priority followup

• In Progress
  • Auditor overhaul #3437 [Dimitrios, Eric, Stefan]
    • Let's schedule meeting afterwards
  • rucio.cfg vs config table #2630 [Mario, David]
    • Merge!
  • Logging review #4220 [Martin, Joel, All comp leads]
    • switch from logging to logger - still a few daemons left
  • Quality of Service #3419 [Matt]
    • Demonstrator for storage-issued QoS changes for BNL MAS
  • Optimize database interactions #4793 [Martin, Mario, Radu]
    • Radu started to look into temp tables
  • Rename Daemons to commonly understandable names #4795 [Martin, Joel]
    • Add aliases now, remove them later (if at all)
    • If you have suggestions for proper names, please add them to the issue
    • Rucio configuration sections named after reaper, conveyor etc -> change too?
  • Prepare replacement of current policy import with policy packages #4798 [James, Martin]
    • Best method to get policy packages into container?
      • Probably not a good idea to pip-install them on startup
    • Fermilab builds separate containers including these
• Todo
  • Get SSO Login working [Rizart]
  • Down-scoped tokens for user interactions #4791 []
  • Versioning for REST API #4796 [Ben, Martin]
  • Enabling tests for different policy package #3878 [Mayank]
    • PolicyPackageTest suite
    • Need to import policy package into test env
• Done
  • Disentangle fts3 specific code from conveyor and move to transfertool #857 [Radu]
  • helm-charts release management #4794 [Radu, Eric, Martin]
• Delayed

Developer roundtable

•  

5 AOB