Rucio Meeting

Thursday 14 Mar 2024, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

15:00 → 15:05 News

• 34 “Donkey Potter and the Data Cache”
  • 34.0.0rc1 had issues
    • Regression from #6516 #6550
    • Regression from #6426 #6551
  • 34.0.0rc2 to be released today
  • 34.0.0 final next week
• Upcoming meetings
  • Mar-21 Rucio 34 release retrospective
  • Apr-04 Rucio 35 release roadmap planning
  • Apr-11 SENSE Rucio presentation

15:05 → 15:25 Community News & DevOps roundtable

• ATLAS
• CMS
  • Updated to Rucio 33.6
• Fermilab
• DUNE
  • Preliminiary version of DUNE VO tests
    • Needs feedback

15:25 → 15:55 Developers roundtable

Progress-2024-03-14.png

• Rucio 34 "Donkey Potter and the Data Cache" roadmap
  • In Progress
  • In Review
    • factorize duplicate messaging code into a common module or class #6423 [Alex]
  • Todo
  • Done
    • Continue migration to SQLAlchemy 2.0 syntax #6057 [Erling]
    • Refactor policy package algorithm code #6382 [James]
    • Metadata for tape co-location and transfer prority #6398 [Maggie]
    • Update/Re-design core.meta module #5224 [Maggie, Rob]
    • Deployment and Release Workflow #401 [Mayank, Eraldo]
    • Add Token based TPC tests to the CI #6451 [Radu]
    • Type annotate the code #6454 [Riccardo]
  • Delayed
    • foreign key error on deleting dids in reaper #5733 [Alex]
    • bridge the gap between running rucio in demo env and full production deployment #187 [Radu, Enrique]
    • Migrate Dashboard to Clean Architecture #158 [Mayank, Eraldo]
    • Missing WebUI Release 33 page tracker #301 [Mayank, Eraldo]
    • Unable to Delete File DID via Undertaker #5154 [Riccardo]
    • Update extension for v32 (and higher) compatibility #25 [Francesc, Enrique]
• Documentation corner
  • Documentation and dev guidelines for Mypy type annotations #116 [Mayank, Martin]
  • Document environmental variables affecting the client #171 [Dimitrios]
  • Improve documentation on rucio.cfg vs configuration table #183 [???]
  • Add an FAQ-style entry aimed at users for STUCK rules #184 [Fabio]
  • Add instruction about DB partitioning #185 [Martin]
  • bridge the gap between running rucio in demo env and full production deployment #187 [Radu]
  • Introduce documentation on subscriptions #190 [Cedric]
  • Add Rucio QoS RSE description and instructions #268 [Matt]
    • Under Review - Comments posted, needs iteration
  • Document how to set up command line argument completion #275 [Bouwe]
  • Formatting / style guide #287 [???]
  • Document how deletion occurs. #288 [Anil]
  • Instructions for tape collocation plugins #289 [Maggie]
  • Documentation for RSE settings #293 [???]
• Other topics
  • Discuss about `ruff` linter: https://github.com/rucio/rucio/issues/6538
    • Substitutes import sorting, flake8
    • Is faster and very well used
    • (isort was planned already, but ruff would do this already)
    • q: can you add formatting?
      • Yes, auto formatting or by specification
      • Concern about auto-formatting
        • Especially how sqlalchemy queries are structured (Our style is not pythonic, but easier to read a "sql-like" query)
        • Possible to specify our own style for sqlalchemy queries?
        • Formatting is optional, but does not have to be activated
          • Is configurable, to some extent
  • helm-charts
    • PR ready for new webui chart
    • Old (web)ui containers + helm-charts were updated as well
  • Use pydantic #6544 for type checking (Instead of type dictionaries)
    • :thumbsup:

15:55 → 16:00 AOB