Rucio Meeting

Europe/Zurich
Martin Barisits (CERN)
Videoconference
Rucio Development Meeting
Zoom Meeting ID
413496641
Host
Martin Barisits
Alternative hosts
Cedric Serfon, Mario Lassnig, Dimitrios Christidis
Passcode
28849311
Useful links
Join via phone
Zoom URL
    • 15:00 15:05
      News 5m
      • Release schedule
        • 1.26.9 just released
          • Last regular release in this release line
          • Supported until July 2023 with LTS patch releases
        • 1.27.0
          • Code freeze Nov 17!
            • Some reviews missing, please be ready to address them
          • RC1 shortly after
          • Final (hopefully) still this month
      • Release schedule for 2022
        • Need release name suggestions!
      • Next meeting
        • Small talk from Radu about new container/helm workflow for rucio.cfg
    • 15:05 15:15
      Community News & DevOps roundtable 10m
      • ATLAS
        • Nothing to report
      • CMS
      • Fermilab
      • DUNE
        • Client-side policy packages development
      • DIRAC
        • Converting DIRAC-Belle2 Rucio integration to MultiVO-DIRAC
          • Issue with `/` in container/dataset name ignored on Server
            • Is part of the schema, but it somehow gets filtered within Rucio
          • Works for Belle 2 - Could be difference between Single-VO and Multi-VO deployment?
            • Issue: #
        • Permission needs to be addressed as well after the above issue is solved
        • DIRAC interface for now only addresses upload
          • Probably no other methods needed, but not entirely clear yet
      • Multi-VO
      • SKAO
        • Moving from 1.23 to 1.26
          • Some issue with the salting (Which changed in 1.24)
      • ESCAPE (In Absence)
        • Some issues with reaper greedy deletion
          • Not really fast enough, might be an issue due to a sign_url crash in the loop?
        • Hermes uses large amount of memory for ESCAPE
          • needs investigation
    • 15:15 15:25
      Hot topics 10m
    • 15:25 15:45
      Rucio-SENSE Interoperation 20m
      Speaker: Jonathan Guiang (Univ. of California San Diego (US))
    • 15:45 15:55
      Developers roundtable 10m

      Rucio 1.27 "Batdonkey v. Superdonkey" priority followup

      • In Progress
        • Auditor overhaul #3437 [Dimitrios, Eric, Stefan] [Longer activity lasting beyond 1.27 release]
          • Let's schedule meeting in November
        • Logging review #4220 [Martin, Joel, All comp leads]
          • Would be good to get into 1.27
        • Quality of Service #3419 [Matt] [Beyond 1.27 release]
          • Demonstrator for storage-issued QoS changes for BNL MAS
          • DOMA QoS
        • Optimize database interactions #4793 [Martin, Mario, Radu] [Beyond 1.27 release]
          • Radu started to look into temp tables
            • Proof of concept works, but different :-) on Oracle
              • Global vs private temporary tables
                • Global needs to be part of schema
          • Meeting with CERN IT DB admins
            • Decrease Transaction (7000 transactions/s)
              • Recently found issue about session handing between API and Core
              • Will be addressed to largely reduce the number of empty rolled back sessions
            • Decrease LOGON rate (7-10 logons/s)
              • Optimization session pools
            • Temporary tables
        • Rename Daemons to commonly understandable names #4795 [Martin, Joel]
          • Add aliases now, remove them later (if at all)
          • If you have suggestions for proper names, please add them to the issue
            • Deadline for this next week
        • Prepare replacement of current policy import with policy packages #4798 [James, Martin] [Beyond 1.27 release]
          • Best method to get policy packages into container?
            • Probably not a good idea to pip-install them on startup
          • Fermilab + CMS builds separate containers including these
        • Enabling tests for different policy package #3878 [Mayank]
          • New GH action workflow
            • Tests are specified via build-matrix 
              • Specify modifications of rucio.cfg
              • Right now it assumes policy package is in container
      • Todo
        • Get SSO Login working [Rizart]
        • Down-scoped tokens for user interactions #4791 [] [Beyond 1.27 release]
        • Versioning for REST API #4796 [Ben, Martin] [Beyond 1.27 release]
      • Done
        • Disentangle fts3 specific code from conveyor and move to transfertool #857 [Radu]
        • helm-charts release management #4794 [Radu, Eric, Martin]
        • rucio.cfg vs config table #2630 [Mario, David]
      • Delayed

      Developer roundtable

      • Metadata
        • PR needs merging, Review is GTG
    • 15:55 16:00
      AOB 5m