Rucio Meeting

Thursday 3 Jul 2025, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

15:00 → 15:05 News

• July & August release schedule
  • Jul-07 37.?
  • Jul-14 32.8.7 LTS (Might be delayed by 4 weeks)
  • Jul-21 37.? and 38.0.0rc1
  • Jul-28 38.0.0
  • Jul-18 38.?
  • Jul-25 35.? LTS (Might be delayed by 4 weeks)
• Reminder: We are now on summer schedule, only fortnightly Rucio meetings!

15:05 → 15:25 Community News & DevOps roundtable

• ATLAS
  • length propagation to containers
    • #events (specific to ATLAS) aggregation would be good as well
    • Would be interesting to see if this custom aggregration can be added to metadata workflows?
• CMS
  • Renaming RSE
    • What to be careful about?
      • subscritpions, source_rse_expressions, rse_expression
      • Monitoring pipeline (Hardcoded names in dashboards etc.)
• Fermilab DUNE / RUBIN
  • Error with exception Steve reported on #support
    • Will try to increase memory
  • Wrong registered checksum
    • Should be possible to update in CLI
• DaFab
• ESCAPE
• MADDEN
  • Chat with Authorisation people (Martin will ping)

15:25 → 15:35 SIG Tokens monthly update

Speaker: Dimitrios Christidis (CERN)

15:35 → 15:55 Developers roundtable

• Reflection about ongoing Sprint 6 (Sprint Board) [Dimitris]
  • Good progress, but lots of review left
  • Sprint discussion (Mayank)
    • How do we deal with tickets in Review?
      • Policy: Move them to the next Sprint, if they can actively work on updates?
• Priority Followup for Rucio 38 "Donkirk" major release
  • Todo
    • Create a new API endpoint for the clients to request tokens #6638 [Dimitrios]
      
      • Update?
    • Implement new token authentication for download #7029 [Dimitrios]
      • Update?
    • Make 0 the top protocol priority #6312 [Dimitrios]
      • Update?
    • Developer Guidelines for Reviews, Testing Requirements #538 [Martin]
    • Run rucio/rucio integ tests for PRs in rucio/containers #310 [Riccardo]
    • Rucio dependencies in test environments should be installed the same way they are installed when Rucio is installed as a package #344 [Riccardo]
    • Merge rucio/rucio/etc/docker/ and rucio/containers/dev #7532 [Riccardo]
  • In Progress
    • Re-Factor test infrastructure #7667 [Dimitris, Karan, Mayank, Riccardo]
      • Tested caching and found inconsistencies with several PRs
        • --> Rolled back
      • Reason for problem is that the source code is build into the containers
        • Thus when caching, the code is not correctly included
      • Change:
        • Will build image, including requirements, source code will be mounted in
    • Prevent multiple Reaper threads from working on the same replicas #6512 [Hugo]
    • Fix static code analysis behaviour for functions decorated with @transactional_session, @read_session and @stream_session #6986 [Riccardo]
      
      • Gateway completed, daemons and core as well
    • Metrics API endpoint: include UNKNOWN sources #6565 [Maggie]
      • Unclear what happened, somebody from ATLAS needed for input
    • EPIC: Migration to NX Monorepo #549 [Mayank] 
      • Going well
    • EPIC: UX Improvements #547 [Mayank]
    • Integrate OIDC endpoints for Authorization Code Grant Type #507 [Mayank]
      • Split into two parts:
        • Switch to new session library
        • Introduce OIDC login on WebUI
  • In Review
    • factorize duplicate messaging code into a common module or class #6423 [Alex] 
    • cx_oracle -> python-oracledb dependency upgrade #6467 [Dimitris]
    • More useful client docstrings and CLI help messages #363 [Dimitris]
    • Improve handling of errors in Rucio REST API calls #39 [Enrique, Giovanni]
    • Add docs for daemon arguments #499 [Maggie]
    • Update test/test_bin_rucio to use fixtures where applicable #7641 [Maggie]
    • race in token creation when running multiple clients on same host #7185 [Maggie]
    • New CLI: Release 38 Bugs/Improvements #7658 [Maggie]
      • Many PRs in review
    • Record rule error for STUCK rule if rse_expression excludes lock_rse in the meanwhile #7538 [Riccardo]
    • Rework OIDC user authentication #7310 [Anil]
    • Dependencies: deprecate setup.py and move to pyproject.toml #6971 [Riccardo]
    • Improve TEMP_UNAVAILABLE replica handling #7666 [Riccardo]
  • Done
    • Policy Package FAQ & emphasis on important details #494 [Riccardo]
    • Plugins and policy packages: using plugin entry points for discovery? #7572 [Riccardo]
    • Add the possibility to archive metadata for deleted DIDs #5484 [Rob, Cedric]
    • Traces : No gateway for traces #7256 [Maggie]
    • EPIC: Handle DID schemas with / #548 [Mayank]
    • Add link to FTS transfers for rules #517 [Mayank]
  • Delayed
• Miscellaneous
  • Janusz drafted PR for obsolete_replica_check to move to abacus/rse_counter
    • Two options to follow:
      • updated_rse_counters table
      • different table for obsolete_replicas counters
  • rucio server endpoints
    • get_rse_attributes endpoint without trailing / does not work?
      • https://github.com/rucio/webui/issues/598

15:55 → 16:00 AOB