Rucio Meeting

Thursday 22 May 2025, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

15:00 → 15:05 News

• CTAO joined the Rucio Advisory Board!
• June meeting schedule
  • Jun-05 Token Update
  • Jun-12
  • Jun-19
  • Jun-26
• Next week no meeting!

15:05 → 15:25 Community News & DevOps roundtable

• ATLAS
• CMS
  • FTS Issue
    • Certificate about to expire
    • Delegate certificate to FTS
      • If certificate expires in less than 3 days, proxy will have that remaining lifetime
    • However
      • FTS does not accept that proxy
      • Bug was reported
  • Lost events (transfer-done event never found, but was in messages_history )
    • in kafka pipeline, sometime rule_creation is picked up instead of event creation
    • Panos is following up (ATLAS should have noticed that issue too)
  • How lost files are handled?
    • --> Create ticket #
• Fermilab DUNE/RUBIN/...
• HEPCCE
  • Discovered bug in code for deletion
    • Works now!
  • Writing a scale test
    • Numbers based on BNL -> NERSC
    • 110k / hour
    • After testing -> PR upstream
  • Handling of consistency checking
    • -> is different with globes
• DaFab
• ESCAPE
  • Working on jupyterlab extension
• IHEP
  • Issue with rucio upload 
    • Takes a lot of time to upload and voms-proxy expired?

15:25 → 15:55 Developers roundtable

• Reflection about ongoing Sprint 3 (Sprint Board) [Maggie]
  • Reminder about issue completion!
  • Need to involve more of the contributors to participate in the Sprints
• Priority Followup for Rucio 38 "Donkirk" major release
  • Todo
    • factorize duplicate messaging code into a common module or class #6423 [Alex]
    • Developer Guidelines for Reviews, Testing Requirements #538 [Martin]
    • Add the possibility to archive metadata for deleted DIDs #5484 [Rob, Cedric]
    • Create a new API endpoint for the clients to request tokens #6638 [Dimitrios]
    • Implement new token authentication for download #7029 [Dimitrios]
    • Make 0 the top protocol priority #6312 [Dimitrios]
    • cx_oracle -> python-oracledb dependency upgrade #6467 [Dimitris]
    • Prevent multiple Reaper threads from working on the same replicas #6512 [Hugo]
    • EPIC: Migration to NX Monorepo #549 [Mayank]
    • Add link to FTS transfers for rules #517 [Mayank]
      • Prioritise for CMS
    • EPIC: UX Improvements #547 [Mayank]
    • Run rucio/rucio integ tests for PRs in rucio/containers #310 [Riccardo]
    • Rucio dependencies in test environments should be installed the same way they are installed when Rucio is installed as a package #344 [Riccardo]
    • Merge rucio/rucio/etc/docker/ and rucio/containers/dev #7532 [Riccardo]
    • Plugins and policy packages: using plugin entry points for discovery? #7572 [Riccardo]
    • race in token creation when running multiple clients on same host #7185 [Maggie]
  • In Progress
    • Re-Factor test infrastructure #7667 [Dimitris, Karan, Mayank, Riccardo]
    • Improve handling of errors in Rucio REST API calls #39 [Enrique]
    • Fix static code analysis behaviour for functions decorated with @transactional_session, @read_session and @stream_session #6986 [Riccardo]
    • Update test/test_bin_rucio to use fixtures where applicable #7641 [Maggie] 
    • New CLI: Release 38 Bugs/Improvements #7658 [Maggie]
    • Metrics API endpoint: include UNKNOWN sources #6565 [Maggie]
    • EPIC: Handle DID schemas with / #548 [Mayank]
    • Integrate OIDC endpoints for Authorization Code Grant Type #507 [Mayank]
    • Improve TEMP_UNAVAILABLE replica handling #7666 [Riccardo]
  • In Review
    • More useful client docstrings and CLI help messages #363 [Dimitris]
    • Add docs for daemon arguments #499 [Maggie]
    • Record rule error for STUCK rule if rse_expression excludes lock_rse in the meanwhile #7538 [Riccardo]
    • Rework OIDC user authentication #7310 [Anil]
    • Dependencies: deprecate setup.py and move to pyproject.toml #6971 [Riccardo]
  • Done
    • Policy Package FAQ & emphasis on important details #494 [Riccardo]
    • Traces : No gateway for traces #7256 [Maggie]
  • Delayed
• Miscellaneous
  • • How do we proceed with type annotations?
      • Enable mypi on the CI?
        • Monitor it as a general metric instead of CI
    • Documentation
      • #325
      • Buy in!

15:55 → 16:00 AOB