Rucio Meeting

Thursday 13 Feb 2025, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

15:00 → 15:05 News

• rucio-dev@cern.ch e-group
  • Plan to set the posting restrictions to members only (for now: external contact was allowed)
    • Reduce spam, etc.
  • We have rucio-contact@cern.ch since a while now for external contact
  • Will implement this on Feb-28

15:05 → 15:25 Community News & DevOps roundtable

• ATLAS
  • 36.3.0
  • Deletion change testing
    • #7386
    • Each deletion request = 5 roundtrips to the storage
    • This was reduced in a patch, which will be included in next release (36.4.0)
• CMS
  • 36.3.0 as well
  • 36.2.0 for new WebUI
  • --deep flag
    • in bin/rucio (legacy) --deep is enforced if dataset depth is >2
    • Needs #7118 to be merged
• DaFab
  • Small improvements for upload/download
• DUNE
  • Consistency checking testing (ATLAS way)
    • Code is available (auditor)
    • How long does it take?
      • Depends on size, for big RSEs 30m-1h
    • Dump frequency for big RSEs? 
      • Once a week
    • xrootd sweep takes many many hours in DUNE (due to directory structure)
      • Empty directories are a problem
      • CMS prunes them from time to time
• ESCAPE
  • 34.6
• HEP-CCE
  • Working Rucio instance!
    • auth is working
    • Getting robus running next
  • Ben joining meeting from March

15:25 → 15:55 Developers roundtable

• Reflection about ongoing Sprint 1 (Sprint Board) [Martin]
• Priority Followup for Rucio 37 "Dungeons and Donkeys" major release
  • Todo
    • Create a new API endpoint for the clients to request tokens #6638 [Dimitrios]
    • Implement new token authentication for download #7029 [Dimitrios]
    • Improve handling of errors in Rucio REST API calls #39 [Enrique]
    • Upgrade to NextJS 15 and App Router #429 [Mayank]
    • Maintain backward compatibility with url's from old webui #131 [Mayank]
    • Integrate OIDC endpoints for Authorization Code Grant Type #507 [Mayank]
    • Type checking does not work properly for functions decorated with ... #6986 [Riccardo]
    • Rucio dependencies in test environments should be installed the same way ... #344 [Riccardo]
    • Testing: Run rucio/rucio integ tests for PRs in rucio/containers #310 [Riccardo]
  • In Progress
    • Include docker image publication in CI/CD #35 [Enrique] Sprint 1
    • Rework OIDC user authentication #7310 [James, Anil] Sprint 1
    • Rucio CLI >=36.0.0 Bugs and Suggestions #7224 [Maggie]
  • In Review
    • Prevent multiple Reaper threads from working on the same replicas #6512 [Hugo] Sprint 1
    • New CLI: Consider switching away from argparse #7253 [Maggie]
  • Done
    • factorize duplicate messaging code into a common module or class #6423 [Alex]
    • psycopg2-binary should not be used in production - psycopg2 should be used instead #6669 [Dimitris] Sprint 1
    • Standardize permission policy check logic #7206 [James] Sprint 1
    • Build multi-arch images to support arm64 machines #354 [Riccardo] Sprint 1
• Developer Roundtable
  • Jobber / probes discussion: https://github.com/rucio/containers/issues/369
  •  

15:55 → 16:00 AOB