Rucio Meeting

Thursday 28 Oct 2021, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

15:00 → 15:05 News

• 1.26.8 patch release
  https://github.com/rucio/rucio/releases/tag/1.26.8
• Two hotfix releases fixing #4954
  • 1.26.7.post1
  • 1.26.8.post1
• Meeting Schedule November
  • Nov 4 CANCELLED
  • Nov 11
  • Nov 18
  • Nov 25
• Security advisory

  • https://github.com/rucio/rucio/security/advisories/GHSA-v988-828w-xvf2

15:05 → 15:15 Community News & DevOps roundtable

• ATLAS
  • SRM to HTTPS compatibility
    • FTS / dCache inconsistency on MKCOL (unclear if dCache or FTS upgrade is needed, or if existing configuration is sufficient)
  • Sonar daemon - remove(?)
    • yes
• CMS
  • Manual patch to post1 due to tape bug
• Fermilab/US
  • Nothing to report
• Belle II
  • Nothing to report
• LDMX
  • Nothing to report
• DIRAC/Rucio
  • Multi-VO compatibility in DIRAC requires changes in Rucio core #4961
    • Janusz is having fun :-)
  • Update ScopeNotFound to include actual scope name
  • DIRAC proxy permissions 400 / 600
• MultiVO
  • Containerise the deployment
  • Problems with WebUI - Followup thread in Slack
  • More code for replica selection for MultiVO + other changes
• ESCAPE
  • Updated to 1.26.6 to 1.26.8 - works well
  • Updated UI from 1.25.7 to 1.26.8
    • Functionality for OpenID Connect missing - Followup thread in Slack
    • Most likely from move to Flask - Mayank might take a look
  • OpenID Connect via CLI does not work either
    • Auth server rucio/web/rest/flaskapi/v1/templates folder does not exist on auth server
    • Check existence of folder in container (also does not exist in WebUI image)
•  

15:15 → 15:25 Hot topics

•  

15:25 → 15:55 Developers roundtable

Rucio 1.27 "Batdonkey v. Superdonkey" priority followup

• In Progress
  • Auditor overhaul #3437 [Dimitrios, Eric, Stefan]
    • Let's schedule meeting in November
  • Logging review #4220 [Martin, Joel, All comp leads]
    • switch from logging to logger - still a few daemons left
  • Quality of Service #3419 [Matt]
    • Demonstrator for storage-issued QoS changes for BNL MAS
  • Optimize database interactions #4793 [Martin, Mario, Radu]
    • Radu started to look into temp tables
    • Meeting with CERN IT DB admins
      • Decrease Transaction (7000 transactions/s)
      • Decrease LOGON rate (7-10 logons/s)
        • Optimization session pools
      • Temporary tables
        • Change big OR-queries to fill temporary table and then join on it
        • Test worked on postgres/mysql, not on oracle yet
          • Needs followup by oracle people
  • Rename Daemons to commonly understandable names #4795 [Martin, Joel]
    • Add aliases now, remove them later (if at all)
    • If you have suggestions for proper names, please add them to the issue
  • Prepare replacement of current policy import with policy packages #4798 [James, Martin]
    • Best method to get policy packages into container?
      • Probably not a good idea to pip-install them on startup
    • Fermilab builds separate containers including these
• Todo
  • Get SSO Login working [Rizart]
  • Down-scoped tokens for user interactions #4791 []
  • Versioning for REST API #4796 [Ben, Martin]
  • Enabling tests for different policy package #3878 [Mayank]
    • PolicyPackageTest suite
    • Need to import policy package into test env
• Done
  • Disentangle fts3 specific code from conveyor and move to transfertool #857 [Radu]
  • helm-charts release management #4794 [Radu, Eric, Martin]
  • rucio.cfg vs config table #2630 [Mario, David]
• Delayed

Developer roundtable

•  

15:55 → 16:00 AOB

• 1.27 release date? (beginning of December? definitely before the end of the year :fingers_crossed:)