Rucio Meeting

Europe/Zurich
Martin Barisits (CERN)
Zoom Meeting ID
69426538800
Host
Martin Barisits
Alternative host
Dimitrios Christidis
Passcode
91434731
Useful links
Join via phone
Zoom URL
    • 15:00 15:05
      News 5m
      • March release schedule
        • Mar-02 39.4.0
        • Mar-09 35.8.4 LTS
        • Mar-09 39.5.0
        • Mar-23 39.6.0 (?)
      • Rucio 40
        • Mar-23 FREEZE
        • Mar-26 RC1
        • Apr-02 FINAL
      • Next week
    • 15:05 15:25
      Community News & DevOps roundtable 20m
      • ATLAS
        • Testing of FTS4
          • Second round after the December tests
          • No changes for Rucio
          • Generate URL for job-ids was changed to previous format
      • CMS
      • Fermilab DUNE/RUBIN/*
        • Update all incommon certificates (Strict deadline)
      • DaFab
      • ESCAPE
        • Running ESCAPE mini data challenge
          • INFN-Bari was running webdav endpoint that was spawning connection timeouts
            • Might have impacted others
        • Maybe EPFL Student to implement role-based access on scopes
          • Hide certain scopes
          • Contact Giovanni about this!
      • CERN IT
        • Also few instances in the data challenge
      • Edinburgh DUNE
        • Issue with rucio upload using wrong protocol for existence check - Steve was able to reproduce it
          • Dimitrios: LAN vs WAN issue?
      • INFN Datalake
        • Rucio upload to S3 based storage element
          • Limit of 5Gb per file
            • Typical S3 client does multipart put, rucio does not
            • Using gfal, would need to check with GFAL developers
      • CTAO
        • Running tests in pre-production environment (ESCAPE data challenge)
          • Double rule setup get STUCK --> Timing would be important, call with Martin to debug
      • MADDEN / ETAP
        • Documentation about OIDC auth
      • IHEP
        • Upgrade ongoing
    • 15:25 15:40
      Discussion of Rucio AI Policy draft 15m
    • 15:40 15:55
      Developers roundtable 15m
      • Reflection about ongoing Sprint 5 (Sprint Board) [Karan]
        • Less people participating; Please mark issue and participate!
      • PR review sprint
        • Decreased! 48 → 39
          • RucioBot doing it's job
          • Please message Karan for suggestions (Or add an issue)
            • waiting-on-author or waiting-on-reviewer labels
            • Chain: Review with change requests --> New commits by author --> Bot should add waiting-on-reviewer
      • Rucio 40 priority followup
        • Todo
          • Create a new API endpoint for the clients to request tokens #6638 [Dimitrios]
          • Implement new token authentication for download #7029[Dimitrios]
          • Prevent multiple Reaper threads from working on the same replicas #6512 [Hugo]
            • Martin to check
          • Generate "Configuration parameters" documentation page automatically, to avoid mismatches between documentation and code #325 [Maggie]
          • Change mixed prometheus_client and probe_metric approachs to use PrometheusPusher #129 [Maggie]
        • In Progress
          • Consider using Python venvs in containers to avoid conflicts with system-installed packages #458 [Ben]
          • Token refresh after expiration #73 [Giovanni]
          • Do not use regex to split did, use scope extraction method #7519 [James]
          • Test stability on LTS branches #7964 child of #7667 [Karan]
          • Pin test helper container images for LTS dev environment (release-38-LTS) #8419 child of #7964 [Karan]
          • Copy implimentation of CLI to new CLI structure #8295 child of #7960 [Maggie]
          • Simplify what we run on CI (test suites, OS, Python versions, DB, …) #7965 child of #7667 [Mayank, Karan]
          • [EPIC] UX improvements (Target 17/22) #621 [Mayank]
          • [ EPIC ] : Mutation Operations and Role Based Access to pages/features (Target 5) #622 [Mayank]
        • In Review
          • Add startup self-check mechanism to block Rucio services when critical diagnostics fail #8197 child of #8011 [Dimitris]
          • Ensure PostgreSQL ENUM types created during Alembic migrations honor the configured schema #8145 child of #7737[Dimitris]
          • Wrong documentation for dids/scope/name/files call #8053[Dimitris]
          • Testing: Make tools/run_tests.sh idempotent #7737 child of #7667 [Dimitris]
          • No way to check or change ownership of a scope using Rucio client #7830 [Maggie]
          • Remove hard-coded one-day lifetime in DIRAC API #8172[Max]
          • Possible Belle II specific code in DIRAC functionality #7824[Max]
        • Done
          • Migrate from Jobber to simple Cron #152 [Eric]
          • DIDs not being shown correctly in the extension after a successful download #95 [Giovanni]
          • Make available + Add to Notebook features failing #83[Giovanni]
          • Listing containers with more than 10k entries breaks the kernel #102 [Giovanni]
          • Rucio silently skips importing configured policy package in case of errors #7962 [Max, James]
          • Remove development dependencies from webui container #488[Mayank]
        • Delayed
          • More useful client docstrings and CLI help messages (Target: 15/25) #363 [Dimitris]
          • Stop auto-forwarding of old-style CLI commands #8294[Maggie]
      • Other discussion
        • Rename of branches
          • master --> main 
          • Consistency but also familiarity (git3 defaults to main too)
          • Start with probes repository, and then go one by one
            • Use variables (already before the change)
    • 15:55 16:00
      AOB 5m