Rucio Meeting

Europe/Zurich
Martin Barisits (CERN)
Zoom Meeting ID
69426538800
Host
Martin Barisits
Alternative host
Dimitrios Christidis
Passcode
91434731
Useful links
Join via phone
Zoom URL
    • 15:00 15:05
      News 5m
      • (Old) WebUI Cross-Site scripting vulnerabilities
        • Please update to 39.3.1 or 38.5.4 LTS or 35.8.3 LTS 
      • March meeting schedule
        • Mar-05 Discussion of AI policy
        • Mar-12
        • Mar-19
        • Mar-26
      • RucioBot active [Karan]
    • 15:05 15:25
      Community News & DevOps roundtable 20m
      • ATLAS
        • Having python clients check additional environment variables
          • E.g. RUCIO_PROTOCOLS or something similar
          • Create an issue and see if there is interest from others
        • WebUI 39.3.5 deployed for ATLAS
          • Add redirect and change routes only in Rucio 40
          • node.js memory usage 
            • Restricted in one of the upcoming container releases
        • Archive metadata
          • CTA team looked into statistics
            • Have a fallback for other instead of datasetname ?
              • Can be addressed in ATLAS policy package
      • CMS
      • Fermilab DUNE/RUBIN
        • New WebUI release for LTS
          • Mayank: Waiting for a PR on containers, should come today
        • Need analysis on #8380 (OIDC Tokens)
        • Started to us pg_bouncer for session pooling postgres sessions
          • 2 weeks, running well
          • Started to use it on DUNE as well, looking good
      • ePIC
      • DaFab
        • Plan a presentation of planned metadata features in Rucio meeting
      • ESCAPE
        • How are people managing RSEs without RSELimits?
          • Hasan: Monitoring space usage, and then turn off availability_write works too
        • Spotting daemon exceptions very hard
          • Exception is multiline, log formatter gives timestamp only on first line
          • Rucio can also do json log output (gives additional metadata)
        • gridftp -> https
          • Needs to multihop
      • INFN Datalake
        • Enabling TPC with OIDC for S3 RSEs #8382
      • MADDEN / ETAP
        • PR for server side changes for automatic mapping of users has errors
          • ruff should give good indication what to change
        • VIRGO Rucio instances from X509 to OIDC shift
      • CTAO
        • DIRAC interface work
        • Timing issue with source_replica_expression  (See internal gitlab issue)
      • IHEP
        • Rucio deployment
          • On old version 29 
          • Upgrade script does not work
    • 15:25 15:55
      Developers roundtable 30m
      • Reflection about ongoing Sprint 4 (Sprint Board) [Maggie]
        • Good progress so far
        • Good split for things in progress/done
      • PR review sprint
        • Slightly increased 58 → 48
        • Bot active!
          • Please send feedback to Karan
      • Rucio 40 priority followup
        • Todo
          • Create a new API endpoint for the clients to request tokens #6638 [Dimitrios]
          • Implement new token authentication for download #7029[Dimitrios]
          • Prevent multiple Reaper threads from working on the same replicas #6512 [Hugo]
          • Generate "Configuration parameters" documentation page automatically, to avoid mismatches between documentation and code #325 [Maggie]
          • Change mixed prometheus_client and probe_metric approachs to use PrometheusPusher #129 [Maggie]
          • Possible Belle II specific code in DIRAC functionality #7824[Max]
          • Remove hard-coded one-day lifetime in DIRAC API #8172[Max]
          • [ EPIC ] : Mutation Operations and Role Based Access to pages/features (Target 5) #622 [Mayank]
        • In Progress
          • Consider using Python venvs in containers to avoid conflicts with system-installed packages #458 [Ben]
            • FYI some changes for the .venv handling with versions incoming
            • Discussion in #7322
          • Token refresh after expiration #73 [Giovanni]
          • Do not use regex to split did, use scope extraction method #7519 [James]
          • Test stability on LTS branches #7964 child of #7667 [Karan]
          • Copy implimentation of CLI to new CLI structure #8295 child of #7960 [Maggie]
          • Simplify what we run on CI (test suites, OS, Python versions, DB, …) #7965 child of #7667 [Mayank, Karan]
          • [EPIC] UX improvements (Target 22) #621 [Mayank]
        • In Review
          • Add startup self-check mechanism to block Rucio services when critical diagnostics fail #8197 child of #8011 [Dimitris]
          • Ensure PostgreSQL ENUM types created during Alembic migrations honor the configured schema #8145 child of #7737[Dimitris]
          • Wrong documentation for dids/scope/name/files call #8053[Dimitris]
          • Testing: Make tools/run_tests.sh idempotent #7737 child of #7667 [Dimitris]
          • No way to check or change ownership of a scope using Rucio client #7830 [Maggie]
        • Done
          • Migrate from Jobber to simple Cron #152 [Eric]
          • Listing containers with more than 10k entries breaks the kernel #102 [Giovanni]
          • DIDs not being shown correctly in the extension after a successful download #95 [Giovanni]
          • Make available + Add to Notebook features failing #83[Giovanni]
          • Rucio silently skips importing configured policy package in case of errors #7962 [Max, James]
          • Remove development dependencies from webui container #488[Mayank]
        • Delayed
          • More useful client docstrings and CLI help messages (Target: 15/25) #363 [Dimitris]
          • Stop auto-forwarding of old-style CLI commands #8294[Maggie]
      • Other discussion
        • Deprecation watchlist
        • AI Policy draft to be circulated after the meeting
          • Please add comments to draft!
        • Deletable replicas to be added to Janusz PR? #7803
    • 15:55 16:00
      AOB 5m