Rucio Meeting

Europe/Zurich
Martin Barisits (CERN)
Zoom Meeting ID
69426538800
Host
Martin Barisits
Alternative host
Dimitrios Christidis
Passcode
91434731
Useful links
Join via phone
Zoom URL
    • 15:00 15:05
      News 5m
      • Rucio 40 Feature Freeze: Mar-23
      • Rucio AI Policy
        • Contacted CERN OSPO for advise on legal angle (Copyright, License)
          • They are working on this, but it is a complex topic and there is lots of interest
        • Please send further comments until Mar-25
          • After that we will enforce the policy
          • We might need adoptions once we receive OSPO advise
    • 15:05 15:25
      Community News & DevOps roundtable 20m
      • ATLAS
        • Old WebUI and HighCharts javascript library
          • License agreement changed, or CDN is enforced more aggressively
          • Needs to be checked what to do with it
            • Volume over time (ATLAS specific)
            • RSE
            • Locks States
            • Bad Replicas
            • Rule states
      • CMS
      • Fermilab DUNE / RUBIN
      • DaFab
      • PIC
        • Issues with certificates at MAGIC instance
        • Encryption on Ingress & backend endpoints
        • Login with certificates works again
        • Rucio @ MAGIC on Rucio 32
          • Upgrading to 38
          • Policy package for MAGIC
        • Other instance for LST to be setup
      • MADDEN / ETAP
        • Fuse-POSIX (rucio fs)
          • Looking into OIDC auth for it now
          • Running
          • Is there community interest in this?
            • PIC interested
        • Nikita looking into CVMFS Plugin
      • CTAO
        • Issue with repairer, source_rse_expression and rules being filled
          • --> updated_at being constantly updated and prevents repairer from touching it
          • #8436
        • Deployed undertaker and reaper daemon for cleanup
          • Default resources in helm-charts basically always kill reaper (to be increased)
          • trust-store certificate issues
            • PIC and CSCS deletion went through!
    • 15:25 15:35
      Deprecation Watchlist 10m
      • PR: https://github.com/rucio/documentation/pull/752
      • Clarify deprecation vs. removal of functionality
      • Watchlist entries to discuss
      Item Removal by when (Will not be included in that release) Comment
      Old CLI structure 42.0 / 2026-Nov ATLAS would like to have a release where the final structure is tested, then it can go out in the next release
      --> structure, fundamental parameters should be stable
      --> This means 41.0 structure and parameters need to be stable
      Old WebUI 43.0 / 2027-Mar

      Is 41.0 2026-Aug feasible?
      We should ask people to deploy the new one earlier, to give us feedback (Don't wait for the last moment)
      Definitely should not be included in 44.0 LTS!

      SRM and GridFTP protocol 41.0 LTS / 2026-Aug Rucio WS 2026: No community claimed they are using it
      MAGIC: Using gridftp (via gfal) - but gfal is going away too
      gfal -> EL11 no version
      EL10 will have gfal, but without plugin for srm and gridftp
      ALMA10: will have to remove it
      Temporary unavailable replicas 43.0 / 2027-Mar  
      Support for MySQL 43.0 / 2027-Mar

      Does this imply we provide a migration procedure to postgres / oracle?

      Volatile RSEs

        What does it really entail?

      Follower daemon

      43.0 / 2027-Mar  

      pCache

        Likely this is ATLAS only?
      Need to check if and how this is used?

      BitTorrent (sorry Radu!)

      43.0 / 2027-Mar Pet project, but in reality, it shouldn't be in the codebase

      Multiple metadata plugins

      42.0 / 2026-Nov Allow only ONE in addition to the DEFAULT
      -> To check

       

    • 15:35 15:55
      Developers roundtable 20m
      • Reflection about ongoing Sprint 5 (Sprint Board) [Karan]
        •  
      • PR review sprint
        • 39 -> 46
      • Rucio 40 priority followup
        • Todo
          • Create a new API endpoint for the clients to request tokens #6638[Dimitrios]
          • Implement new token authentication for download #7029[Dimitrios]
          • Prevent multiple Reaper threads from working on the same replicas #6512 [Hugo]
          • Change mixed prometheus_client and probe_metric approachs to use PrometheusPusher #129 [Maggie]
        • In Progress
          • Consider using Python venvs in containers to avoid conflicts with system-installed packages #458 [Ben]
          • Token refresh after expiration #73 [Giovanni]
          • Do not use regex to split did, use scope extraction method #7519[James]
          • Test stability on LTS branches #7964 child of #7667 [Karan]
          • Pin test helper container images for LTS dev environment (release-38-LTS) #8419 child of #7964 [Karan]
          • Copy implimentation of CLI to new CLI structure #8295 child of #7960 [Maggie]
          • Simplify what we run on CI (test suites, OS, Python versions, DB, …) #7965 child of #7667 [Mayank, Karan]
          • [EPIC] UX improvements (Target 22) #621 [Mayank]
        • In Review
          • Add startup self-check mechanism to block Rucio services when critical diagnostics fail #8197 child of #8011 [Dimitris]
          • Ensure PostgreSQL ENUM types created during Alembic migrations honor the configured schema #8145 child of #7737[Dimitris]
          • Wrong documentation for dids/scope/name/files call #8053[Dimitris]
          • Testing: Make tools/run_tests.sh idempotent #7737 child of #7667 [Dimitris]
          • No way to check or change ownership of a scope using Rucio client #7830 [Maggie]
          • Generate "Configuration parameters" documentation page automatically, to avoid mismatches between documentation and code #325 [Maggie]
          • Remove hard-coded one-day lifetime in DIRAC API #8172 [Max]
          • Possible Belle II specific code in DIRAC functionality #7824[Max]
            • Re-Apply maggies change for the dirac client #8225
          • [ EPIC ] : Mutation Operations and Role Based Access to pages/features (Target 5) #622 [Mayank]
        • Done
          • Migrate from Jobber to simple Cron #152 [Eric]
          • DIDs not being shown correctly in the extension after a successful download #95 [Giovanni]
          • Make available + Add to Notebook features failing #83 [Giovanni]
          • Listing containers with more than 10k entries breaks the kernel #102 [Giovanni]
          • Rucio silently skips importing configured policy package in case of errors #7962 [Max, James]
          • Remove development dependencies from webui container #488[Mayank]
        • Delayed
          • More useful client docstrings and CLI help messages (Target: 15/25) #363 [Dimitris]
          • Stop auto-forwarding of old-style CLI commands #8294 [Maggie]
      • Other discussion
        • Janusz: Deletable_replicas in abacus counter added in PR (Tests pass)
    • 15:55 16:00
      AOB 5m