Rucio Meeting

Thursday 21 Oct 2021, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

1 News

• Rucio clients now on conda-forge
• Release plan
  • Slight update on dates for next releases
  • 1.26.6 Oct 20
  • 1.26.7 Oct 27
  • 1.26.8 Nov 8

2 Community News & DevOps roundtable

• ATLAS
  • Reaper deletion issues with gfal-http
    • http default timeout is 8000s
    • One faulty storage can bring all the deletion down with this
• CMS
  • Few PRs open from Igor
    • Dependent on each other, would be good if they are merged
• Fermilab/US
  • New RUBIN instance at SLAC
    • Transfer going between some sites
    • 10-12TB during the night
• Belle II
• LDMX
• DIRAC/Rucio
  • Some issues with MultiVO passing the VO through DIRAC-Rucio interface, needs some more work
  • extract_scope algorithm not really multi-vo, PR still covers intermediate step though, James 
• MultiVO
  • More updates for MultiVO, now having 1.26 server running
• ESCAPE
  • Updated to 1.26.6 
  • WebUI Issues
    • With privilige escalation
    • OIDC login button not there?
      • Rizart will investigate
    • HTML templates do not exist
      • Container/Packaging/deployment issue?
  • Helm-charts
    • Versions in sync with rucio versions

3 Hot topics

• Possible Privilege Escalation in WebUI 1.26?
  • Related to #4810
  • ESCAPE will try to reproduce and see if it is display issue or actual privilige escalation issue
    • If confirmed, we need to pull all 1.26.* webui immediately

4 Developers roundtable

Rucio 1.27 "Batdonkey v. Superdonkey" priority followup

• In Progress
  • Auditor overhaul #3437 [Dimitrios, Eric, Stefan]
    • Let's schedule meeting in November
  • Logging review #4220 [Martin, Joel, All comp leads]
    • switch from logging to logger - still a few daemons left
  • Quality of Service #3419 [Matt]
    • Demonstrator for storage-issued QoS changes for BNL MAS
  • Optimize database interactions #4793 [Martin, Mario, Radu]
    • Radu started to look into temp tables
    • Meeting with CERN IT DB admins
      • Decrease Transaction (7000 transactions/s)
      • Decrease LOGON rate (7-10 logons/s)
        • Optimization session pools
      • Temporary tables
        • Change big OR-queries to fill temporary table and then join on it
        • Test worked on postgres/mysql, not on oracle yet
          • Needs followup by oracle people
  • Rename Daemons to commonly understandable names #4795 [Martin, Joel]
    • Add aliases now, remove them later (if at all)
    • If you have suggestions for proper names, please add them to the issue
  • Prepare replacement of current policy import with policy packages #4798 [James, Martin]
    • Best method to get policy packages into container?
      • Probably not a good idea to pip-install them on startup
    • Fermilab builds separate containers including these
• Todo
  • Get SSO Login working [Rizart]
  • Down-scoped tokens for user interactions #4791 []
  • Versioning for REST API #4796 [Ben, Martin]
  • Enabling tests for different policy package #3878 [Mayank]
    • PolicyPackageTest suite
    • Need to import policy package into test env
• Done
  • Disentangle fts3 specific code from conveyor and move to transfertool #857 [Radu]
  • helm-charts release management #4794 [Radu, Eric, Martin]
  • rucio.cfg vs config table #2630 [Mario, David]
• Delayed

Developer roundtable

•  

5 AOB