Rucio Meeting

Thursday 23 Apr 2026, 15:00 → 16:00 Europe/Zurich

61/1-007 - Room B (CERN)

Martin Barisits (CERN)

15:00 → 15:05 News

• Rucio 40 finally out
  • 40.1 on Monday
• Rucio SIG Hierarchical Namespaces kick-off
  • Was yesterday with some community representatives to work on this
  • We will propose a document with steps/changes to make hierarchical namespaces a primary feature in Rucio
    • Community feedback is then needed
• Thank you to Karan
  • Karan finishes his contract end of April, this will be hist last meeting!
  • Thanks a lot for all the effort and the great collaboration!
  • It's a thank you, but not a goodbye, Karan will stay at CERN, but not within Rucio

15:05 → 15:25 Community News & DevOps roundtable

• ATLAS
• CMS
• Fermilab DUNE / RUBIN / ...
  • DUNE pg_bouncer deployment
  • RUBIN tweaking FTS service
    • group_bulk in Rucio
    • Reduce time between runs 
    • #8380 issue 
• ePIC
  • Martin: Reminder to followup with Doug
• ESCAPE
• MADDEN /  ETAP
  • rucio-fs OIDC implementation
  • alembic migration script difficulty
    • Dimitris Xenakis can help with it
  • Tokens in daemons
    • Possibility to request tokens with group capabilities
      • Right now no
• IHEP
  • Finished upgrade to 38 LTS
• DaFab
  • Working on Metadata engine an filtering usecases
• CERN IT

15:25 → 15:45 Rucio 40 release retrospective

Speaker: Martin Barisits (CERN)

Rucio 40 retrospective

Rucio 40 retrospective

• Actions from 39 retrospective
  • Move tests in the testsuite to the unittest folder
  • Coverage is currently only based on unittest (not intake)
  • Split coverage by unit and intake tests - make it clear to somebody looking at PRs
  • Need code coverage strategy
  • Work on contribution standards, we need to raise the bar to make review easier for the few reviewers
  • Add another person (at least) to merger team
  • How could we run integration tests with e.g. hierarchical schemas, dirac, etc. ?
  • Run tests differently based on policy package
• Actions from previous reviews
  • 🚧 Clarify RSE settings vs. attributes -> Full move to attributes might be difficult
  • 🚧 Implement a client release test procedure
  • Documentation how to setup an RSE (for newcomers, and best practices)
  • Formalise consistency guidelines for adding new RSE attributes, settings, commands, rest endpoints etc. (more discsssuion to follow)
  • 🚧 Add review guidelines to the contribution guide (Testcases)
  • 🚧 Add/Clarify merging, code freeze, release logic, to the contribution guide
  • Investigate changes to merging policy, code freeze policy, and release logic
  • 🚧 Need to be stricter during ticket review
    • Maybe include the bot to do some assignment/triage work
    • We could close stale issues to decrease the backlog --> Need to look into that
  • 🚧 A clearer picture of the dependencies between components (which component relies on what?) -> Split into packages with pyproject files might help
    • We will work on requirements management first
  • 🚧 Even more people could merge approved prs
  • More automation in our PR reviews (Closing of stale/unanswered PRs etc.)

15:45 → 15:55 Developers roundtable

• Reflection about ongoing Sprint 1 (Sprint Board) [Martin]
  •  
• PR review sprint
  • 40 -> 43
• Rucio 41 priority followup
  • Todo
    • None: Convert RSE availabilities from a boolean to an enum #6660 [Ben]
    • M: Datasets erased through the Reaper do not produce any messages #8022 [Ben]
    • M: Old WebUI OIDC must not use Host header for authentication flow #8473 [Ben]
    • S: Rucio WebUI authentication cookie without HttpOnly flag #8475 [Ben]
    • M: Implement new token authentication for download #7029[Dimitrios]
    • XL: Finalise CLI command structure #8349 [Maggie, Reviewer: Dimitrios]
    • S: Rucio Python Client docstrings enhancement (Accountclient) #509 child of #363 [Dimitris, Maggie]
    • XS: Rucio Python Client docstrings enhancement (Configclient) #513 child of #363 [Dimitris, Maggie]
    • XS: Rucio Python Client docstrings enhancement (Ruleclient) #529 child of #363 [Dimitris, Maggie]
    • S: Rucio Python Client docstrings enhancement (Rseclient) #528child of #363 [Dimitris, Maggie]
    • XS: npm_and_yarn dependabot jobs failing #123 [Francesc]
    • XS: Cannot authenticate to account with given credentials [x509 proxy] #98 [Francesc]
    • L: Token refresh after expiration #73 [Giovanni]
    • L: Prevent multiple Reaper threads from working on the same replicas #6512 [Hugo]
    • XL: Rework OIDC user authentication #7310 [James, Anil]
    • M: Do not use regex to split did, use scope extraction method #7519 [James]
    • M: Schema values overridden in policy package are not picked up unless at top level #7731 [James]
    • M: rucio upload does not check that the user has permission to add DIDs #6058 [James]
    • S: Remove SRM and GridFTP protocols #8497 [Maggie]
    • L: allow wildcard * on a scope level for list_dids #6070 [Max, Reviewer: Mario]
    • L: Create a new API endpoint for the clients to request tokens #6638 [Dimitrios, Reviewer: Martin]
    • XL: Rucio support for full-structure metadata #8011 [Dimitris, Reviewer: Martin]
    • XL: Fixing requirements #8500 [Ben, Reviewer: Martin]
    • M: Let metadata plugins implement get_metadata_bulk #7324[Max]
    • L: Make scope optional in all API endpoints using scope + name information #8196 [Maggie, Reviewer: Max]
    • XL: Permission Management based on the server side Policy #739[Mayank]
    • XL: Replace Env Generator Tool and EnvConfigGateway with Zod Schema-Based Env Validation #753 [Mayank]
    • XL: Feature Flags Subsystem for Page/View Enablement #752[Mayank]
    • XL: Simplify what we run on CI (test suites, OS, Python versions, DB, …) #7965 child of #7667 [Mayank]
  • In Progress
    • XL: Fix flaky tests #8270 [Dimitris, Reviewer: Ben]
    • S: Improve Juptyerlab extension operator guide #768 [Giovanni]
    • XL: Test stability on LTS branches #7964 child of #7667 [Karan, Reviewer: Martin]
    • XL: [EPIC] UX improvements (Target 22) #621 [Mayank]
  • In Review
    • XS: Wrong documentation for dids/scope/name/files call #8053 [Dimitris]
    • M: Generate "Configuration parameters" documentation page automatically, to avoid mismatches between documentation and code #325 [Maggie]
    • M: Change mixed prometheus_client and probe_metric approachs to use PrometheusPusher #129 [Maggie]
    • S: Make loaded CLI options configurable #8494 child of #8349[Maggie]
  • Done
  • Delayed
• Other discussion
  
  • •  

15:55 → 16:00 AOB