Rucio Meeting

Thursday 31 Jul 2025, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

15:00 → 15:05 News

• 38 Release
  • Still testing 38.0.0rc2
    • Some issues with new oracledb driver
  • Ideally have final release next week, but due to vacation period to be seen
• August meeting schedule
  
  • Aug-14
  • Aug-28: 39 Release Roadmap

15:05 → 15:25 Community News & DevOps roundtable

• ATLAS
  • DB utilization very high due to collection replica queries
    • Which are, since 1-2 years, --deep and querying 50k+ rows each time
      • Isolated, this is ok, multiplied by number of requests, it gets CPU utilisation into problematic areas
    • Need to understand the situation better:
      • Is it necessary by the external client to call that query that often
      • But secondly, is it something we WANT to optimise (for communities with very large datasets) natively
• CMS
  • Deletion rule of big rules does not work (takes very long)
    • Likely due to rowlocks because the rule is in the process of transferring, (judge-evaluator, etc.)
• Fermilab DUNE/RUBIN
  • Servers restarting issue
    • Memory increased from 2Gb to 3Gb
      • Still same issue
      • Ticket https://github.com/rucio/rucio/issues/7807 as well
• ePIC
• DaFab
• ESCAPE
  
  • Update cluster to 35.8
  • Rucio jupyterlab extension on EOSC ressources
    • Problem with oidc token download
    • Try installing gfal package, test again
• CERN IT
• MADDEN
  • CVMFS plugin? 
    • On hold, no student
  • rucio-fs for big amount of files
    • Are there any numbers of large-scale tests?
      • Martin can check
  • upload client instead of bash script
    • --> github issue #
  • Multihost implementation #7880
    • Please give feedback! And questions
• RAL
• IHEP
  • Data transfer for HERD
    • CERN -> IHEP
      • Small issue for max connection on postggres (Was easy to solve)

15:25 → 15:50 Rucio 38 "Donkirk" release retrospective

Speaker: Martin Barisits (CERN)

38 release retrospective

• Ongoing actions from previous retrospectives
  • Review setup of development environment, make it easier to onboard developers -> have a generic version?
  • Review mechanism (survey, kill list, ...) how to deprecate unused features
  • Fixing codecov to have less failing tests, which will be ignored
  • WIP Continue improving docustrings / method documentation
  • WIP Effort to make the docstrings / API documentation more consistent
  • WIP Documentation of how the config table vs cfg file works, and when which one should be used.
  • Organise another DocuSprint
  • WIP Clarify RSE settings vs. attributes -> Full move to attributes might be difficult (Brandon was working on this too)
  • Continue with CiLogon token support
  • WIP Implement a client release test procedure
  • Get more people into code reviews
  • Documentation how to setup an RSE (for newcomers, and best practices)
  • Formalise consistency guidelines for adding new RSE attributes, settings, commands, rest endpoints etc. (more discsssuion to follow)
  • WIP Implement conventional commits
  • Add review guidelines to the contribution guide (Testcases)
  • Investigate ways of introducing reviewers in parts of review
  • WIP Add/Clarify merging, code freeze, release logic, to the contribution guide
  • WIP Investigate changes to merging policy, code freeze policy, and release logic
  • Need to be stricter during ticket review

15:50 → 15:55 Developers roundtable

15:55 → 16:00 AOB