Focus on:  Hide Contributions
Login

Rucio Meeting

→ Europe/Zurich
Martin Barisits (CERN)
    • 15:00 → 15:05
      News 5m
      • Regression in deletion with tokens
        • Starting in 33.1.0 regression with deletion via tokens (Also in 33.2.0, 33.2.1)
        • Is not breaking, but deletion will use x509 proxies instead of tokens
        • Fix will be included in release on Monday (33.3.0 or 33.2.2)
    • 15:05 → 15:25
      Community News & DevOps roundtable 20m
      • ATLAS
        • Will try to run Rucio on ARM ressources
        • Token testing
          • Update at yesterdays WLCG BDT meeting
          • ATLAS increasing token sites
          • Ramping up to have things ready for DC24
      • CMS
        • v33 going to INT instance
        • Token testing
          • Read / Write from storage (manual tests)
          • Trying to make it work with FTS
            • Possibly an issue with IAM permissions to get fts-scoped token
          • Sites compatibility with tokens an issue
            • Sites potentially simply making the tests work, but actual production load does not
      • Fermilab DUNE / ICARUS / RUBIN ...
        • RUBIN
          • Automatix work
          • 33.2 running
        • Everyone at FNAL, other than DUNE, running 33.2 as well
        • DUNE
          • 1.29 LTS on PROD, waiting for go-ahead for upgrade
          • Scaling issue due to only running one server, loadbalancing and scale-out coming
          • Workload system asking information per file
        • ICARUS
          • Working on some connection issues with a user
        • SpinQuest evaluating Rucio
      • ALTO
        • Almost done with Transfer monitoring PR
        • Proposal for new Working Group, include not only network information, but also include compute
          • Will be discussed in coming IETF meeting
      • RAL / MutliVO
        • Hermes auth to Elastic search
          • Running into locking issues if running more than 1 hermes
            • Potentially an issue with hertbeats / workload splitting?
        • GGUS "Rucio"
          • Was renamed to "Rucio @ RAL"
    • 15:25 → 15:55
      Developers roundtable 30m
      Progress-2024-01-18.png
      • Rucio 34 "Donkey Potter and the Data Cache" roadmap
        • In Progress
          • foreign key error on deleting dids in reaper #5733 [Alex]
          • factorize duplicate messaging code into a common module or class #6423 [Alex]
          • Continue migration to SQLAlchemy 2.0 syntax #6057 [Erling]
          • Refactor policy package algorithm code #6382 [James]
          • Update/Re-design core.meta module #5224 [Maggie, Rob]
          • Deployment and Release Workflow #401 [Mayank, Eraldo]
          • Missing WebUI Release 33 page tracker #301 [Mayank, Eraldo]
          • Unable to Delete File DID via Undertaker #5154 [Riccardo]
          • Type annotate the code #6454 [Riccardo]
        • In Review
          • Metadata for tape co-location and transfer prority #6398 [Maggie]
          • Add Token based TPC tests to the CI #6451 [Radu]
            • Tried to have storage with basic apache webdav servers, which did not work due to TPC
            • Replaced by xrootd+webdav servers, but getting random segfaults
              • Even when not using tokens
              • Opened issue on xrootd side
        • Todo
          • Update extension for v32 (and higher) compatibility #25 [Francesc, Enrique]
          • Migrate Dashboard to Clean Architecture #158 [Mayank, Eraldo]
          • bridge the gap between running rucio in demo env and full production deployment #187 [Radu, Enrique]
        • Done
        • Delayed
      • Documentation corner
        • Documentation and dev guidelines for Mypy type annotations #116 [Mayank, Martin]
        • Document environmental variables affecting the client #171 [Dimitrios]
        • Improve documentation on rucio.cfg vs configuration table #183 [Radu]
        • Add an FAQ-style entry aimed at users for STUCK rules #184 [Fabio]
        • Add instruction about DB partitioning #185 [Martin]
        • bridge the gap between running rucio in demo env and full production deployment #187 [Radu]
        • Introduce documentation on subscriptions #190 [Cedric]
        • WebUI: Improve Docs #255 [Eraldo]
        • Add instructions for Mac Apple Silicon in the developer section #261 [Eraldo]
          • Under Review
        • Add Rucio QoS RSE description and instructions #268 [Matt]
          • Under Review
      • Other topics
        • Command for a non-existing DID: What would be the path Rucio (and the policy package) would generate for it?
          • Would need additional information for non-deterministic path generation (parent dataset, metadata, etc.)
          • --> #ticket
    • 15:55 → 16:00
      AOB 5m