Rucio Meeting

Europe/Zurich
Martin Barisits (CERN)
Zoom Meeting ID
69426538800
Host
Martin Barisits
Alternative host
Dimitrios Christidis
Passcode
91434731
Useful links
Join via phone
Zoom URL
    • 15:00 15:05
      News 5m
      • Next minor release
        • June 25 (Off schedule due to vacation)
      • 41 “Donkémon”
        • Feature freeze: Jul-06 (3+ weeks from now!)
        • RC1 in the week of Jul-13
        • Final in the week of Jul-20
    • 15:05 15:25
      Community News & DevOps roundtable 20m
      • ATLAS
        • Jumbo rules
          • 400k files
            • Injector can process these, but other rule daemons, can not 
              • repairer?
            • Finisher was struggling as well
            • Raising awareness for this
      • CMS
        • Policy package issue: #8584
          • Needs input from Dimitrios
        • RSE Decomissioner ATLAS specific method
          • PR: https://github.com/rucio/rucio/pull/8581
            • @cserf
      • Fermilab DUNE / RUBIN / ...
        • Jumbo rules issue (1M+ files) 
          • Can be broken down to individual containers
        • Issue: https://github.com/rucio/rucio/issues/8566
          • Martin will check
        • RUBIN
          • RSEs just used to transfer data there and then forget
            • RSE set for deletion MOCK protocol
              • Reaper will do catalog operations, but not remove the data
      • EPIC
        • requests_history and messages_history cleanup
          • Partition should be added to upstream schema, but it isn't there yet
      • DaFab
      • CERN IT
        • Timeout for list dids * with millions of dids
      • DUNE Edinburgh
      • INFN Datalake
      • MADDEN / ETAP
        • Migrated server to 39 release
          • Still on 38
        • OIDC posix implementation in fuse-posix rucio
          • Discussion on token changes (needs to be followed up offline)
        • Event message handling
      • CTAO
        • Update to 40.3.0
          • judge-repairer timeout delta
            • Worked flawlessly
          • ActiveMQ discussion with CERN
            • Resolved
      • IHEP
    • 15:25 15:55
      Developers roundtable 30m
      • Reflection about ongoing Sprint 4 (Sprint Board)
        •  
      • PR review sprint/marathon
        • 38 -> 39
        • Goal is to get to 25 :-)
      • Rucio 41 priority followup
        • Todo
          • M: Old WebUI OIDC must not use Host header for authentication flow #8473 [Ben]
          • S: Rucio WebUI authentication cookie without HttpOnly flag #8475 [Ben]
          • L: Create a new API endpoint for the clients to request tokens #6638 [Dimitrios, Reviewer: Martin]
          • M: Implement new token authentication for download #7029 [Dimitrios]
          • XL: Rucio support for full-structure metadata #8011 [Dimitris, Reviewer: Martin]
            • To achieve some of the sub-issues, but not all
          • XS: Rucio Python Client docstrings enhancement (`Configclient`) #513 child of #363 [Dimitris, Maggie]
          • XS: Rucio Python Client docstrings enhancement (`Ruleclient`) #529 child of #363 [Dimitris, Maggie]
          • XS: npm_and_yarn dependabot jobs failing #123 [Francesc]
            • Martin will ping
          • XS: Cannot authenticate to account with given credentials [x509 proxy] #98 [Francesc]
            • Martin will ping
          • L: Token refresh after expiration #73 [Giovanni]
            • Martin will ping
        • In Progress
          • XL: Fixing dependency management #8500 [Ben, Reviewer: Martin]
          • XL: Fix flaky tests #8270 [Ben, Reviewer: Dimitris]
          • XL: Finalise CLI command structure #8349 [Maggie, Reviewer: Dimitrios]
          • XL: Simplify what we run on CI (test suites, OS, Python versions, DB, …) #7965 child of #7667 [Mayank, Reviewer: Ben]
          • XL: Feature Flags Subsystem for Page/View Enablement #752 [Mayank]
          • L: allow wildcard * on a scope level for list_dids #6070 [Max, Reviewer: Mario]
            • Active question, Martin should answer
          • M: Let metadata plugins implement `get_metadata_bulk` #7324 [Max]
            • Depends on Dimitris issue, approved, but not merged
            • Martin will check
        • In Review
          • M: Datasets erased through the Reaper do not produce any messages #8022 [Ben] 
          • XS: Wrong documentation for `dids/scope/name/files` call #8053 [Dimitris]
          • S: Rucio Python Client docstrings enhancement (`Rseclient`) #528 child of #363 [Dimitris, Maggie]
          • S: Rucio Python Client docstrings enhancement (`Accountclient`) #509 child of #363 [Dimitris, Maggie]
          • M: Do not use regex to split did, use scope extraction method #7519 [James]
          • M: Schema values overridden in policy package are not picked up unless at top level #7731 [James]
          • M: rucio upload does not check that the user has permission to add DIDs #6058 [James]
          • S: Remove SRM and GridFTP protocols #8497 [Maggie]
          • M: Replace some "add" and "update" CLI commands with "set" #8547 [Maggie, Reviewer: Dimitrios]
          • M: Generate "Configuration parameters" documentation page automatically, to avoid mismatches between documentation and code #325 [Maggie]
          • M: Change mixed prometheus_client and probe_metric approachs to use PrometheusPusher #129 [Maggie]
          • S: `get_metadata_bulk` ignores `plugin` when `inherit=False` #7323 child of #8011 [Max, Dimitris]
        • Done
          • M: remove auto feature for oidc auth #8318 child of #7310 [Anil]
          • S: Improve Juptyerlab extension operator guide #768 [Giovanni]
          • XL: Test stability on LTS branches #7964 child of #7667 [Karan, Reviewer: Martin]
          • S: Make loaded CLI options configurable #8494 child of #8349 [Maggie]
          • XL: [EPIC] UX improvements (Target 22) #621 [Mayank]
            • Done, but not closed
        • Delayed
          • XL: Convert RSE availabilities from a boolean to an enum #6660 [Ben, Reviewer: Dimitrios]
          • L: Prevent multiple Reaper threads from working on the same replicas #6512 [Hugo, Reviewer: Dimitrios]
          • L: Make scope optional in all API endpoints using scope + name information #8196 [Maggie, Reviewer: Max]
          • XL: Permission Management based on the server side Policy #739 [Mayank]
          • XL: Replace Env Generator Tool and EnvConfigGateway with Zod Schema-Based Env Validation #753 [Mayank]
      • Other discussion
        •  
    • 15:55 16:00
      AOB 5m