Rucio Meeting

Thursday 17 Apr 2025, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

1 News

• 37.1.0.post1 hotfix release
  • Fixes containers missing dependency
• priority / protocol change with 38 
  • Will send an eMail to the developer mailing list

2 Community News & DevOps roundtable

• ATLAS
  • Overload of Rucio, possibly due to a rogue user
    • Still under investigation
• CMS
• Fermilab DUNE / RUBIN
  • New version for tokens deployed
    • In testing
  • New FTS server and k8s for DUNE
• DUNE
• EPIC / JLAB
  • SMEs at JLAB looking into Rucio
  • crc32 checksums
    • Usable in FTS? Needs to be checked
  • Idea is to store generic checksums in did tables
• HEPCCE
  • Bulk / Single transfer issue with Globus
    • Configuration of the submitter needs to be changed to submit bulks to globus (bulk vs group_bulk)
  • Starting to test deletion soon
• DaFab
• ESCAPE
  • Integrating Rucio jupyterlab plugin into SWAN
• DUNE / Edinburgh
  • Full stack test with CiLogon tokens
    • FTS server or Rucio issue?
• CERN IT
  • Working on the / usage of slashes
• IHEP

3 Developers roundtable

• Reflection about ongoing Sprint 1 (Sprint Board) [Martin]
  • Some general feedback: What's good, what should be improved about the sprints?
• Priority Followup for Rucio 38 "Donkirk" major release
  • Todo
    • factorize duplicate messaging code into a common module or class #6423 [Alex]
    • Developer Guidelines for Reviews, Testing Requirements #538 [Martin]
    • Add the possibility to archive metadata for deleted DIDs #5484 [Rob, Cedric]
    • Create a new API endpoint for the clients to request tokens #6638 [Dimitrios]
    • Implement new token authentication for download #7029 [Dimitrios]
    • Make 0 the top protocol priority #6312 [Dimitrios]
    • Improve handling of errors in Rucio REST API calls #39 [Enrique]
    • More useful client docstrings and CLI help messages #363 [Dimitris]
      • Would be good to make the Python Client documentation more structured?
    • cx_oracle -> python-oracledb dependency upgrade #6467 [Dimitris]
    • Re-Factor test infrastructure #7667 [Dimitris, Mayank, Riccardo]
    • Prevent multiple Reaper threads from working on the same replicas #6512 [Hugo]
    • Integrate OIDC endpoints for Authorization Code Grant Type #507 [Mayank]
    • EPIC: Handle DID schemas with / #548 [Mayank]
      • Prioritise for CMS
    • EPIC: Migration to NX Monorepo #549 [Mayank]
    • Add link to FTS transfers for rules #517 [Mayank]
      • Prioritise for CMS
    • Fix static code analysis behaviour for functions decorated with @transactional_session, @read_session and @stream_session #6986 [Riccardo]
    • Run rucio/rucio integ tests for PRs in rucio/containers #310 [Riccardo]
    • Rucio dependencies in test environments should be installed the same way they are installed when Rucio is installed as a package #344 [Riccardo]
    • Merge rucio/rucio/etc/docker/ and rucio/containers/dev #7532 [Riccardo]
    • Plugins and policy packages: using plugin entry points for discovery? #7572 [Riccardo]
    • Record rule error for STUCK rule if rse_expression excludes lock_rse in the meanwhile #7538 [Riccardo]
    • Improve TEMP_UNAVAILABLE replica handling #7666 [Riccardo]
    • Add docs for daemon arguments #499 [Maggie]
    • race in token creation when running multiple clients on same host #7185 [Maggie]
    • Metrics API endpoint: include UNKNOWN sources #6565 [Maggie]
    • Update test/test_bin_rucio to use fixtures where applicable #7641 [Maggie]
  • In Progress
    • New CLI: Release 38 Bugs/Improvements #7658 [Maggie]
    • EPIC: UX Improvements #547 [Mayank]
  • In Review
    • Rework OIDC user authentication #7310 [Anil]
    • Dependencies: deprecate setup.py and move to pyproject.toml #6971 [Riccardo]
    • Traces : No gateway for traces #7256 [Maggie]
  • Done
    • Policy Package FAQ & emphasis on important details #494 [Riccardo]
  • Delayed
• Miscellaneous
  • • Create a tracking issue for Globus developments
    •  

4 AOB