Focus on:  Hide Contributions
Login

Rucio Meeting

→ Europe/Zurich
Martin Barisits (CERN)
Rucio Meeting
Zoom Meeting ID
69426538800
Host
Martin Barisits
Alternative host
Dimitrios Christidis
Passcode
91434731
Useful links
Join via phone
Zoom URL
    • 15:00 → 15:05
      News 5m
      • 39.0.0
        • RC1 having some issues - unclear if container issue or pip package issue -> under investigation 
      • December release schedule
        • Probably another RC
        • 39 Final still in December
        • 39.1.0 perhaps only in January
    • 15:05 → 15:20
      Community News & DevOps roundtable 15m
      • ATLAS
        • RC1 discussed
        • Testing of FTS 4 on test instance
          • Low traffic (1-2M/day), various issues identified, test progressing well
          • For Rucio, no changes needed, all works out of the box
          • Tests will continue into January
      • CMS
      • DUNE/RUBIN
      • EPIC
      • DaFab
      • CERN IT
      • DUNE @ Edinburgh
        • Upload scaling improved
        • Token tests planned
      • CTAO
        • New release 
    • 15:20 → 15:45
      Rucio 39 "Grand Theft Donkey" release retrospective 25m
      Speaker: Martin Barisits (CERN)
      Retrospective Board
      Retrospective Board
      • Todo
      • In Progress
      • In Review
      • Done
        • Make 0 the top protocol priority #6312 [Dimitrios]
        • Rucio Python Client docstrings enhancement (Credentialclient) #7842 child of #363 [Dimitris]
        • use literal to store allowed algorithm names for type hints and validation #7858 [James]
        • Confusing log message ‘Policy algorithm module XXX could not be loaded’ #7941 [James]
        • Add tests for default policy algorithm fallbacks #7881 [James]
        • Enforce Conventional Commits in CI #7945 child of #7667[Karan]
        • Unused request gateway functions #7625 [Maggie]
        • Validate account type at account creation #6957 [Maggie]
        • Add docs for daemon arguments #499 [Maggie]
        • Unused config gateway functions #7624 [Maggie]
        • [EPIC: Release 39] UX improvements #621 [Mayank]
        • Integrate OIDC endpoints for Authorization Code Grant Type #507 [Mayank]
        • Dependencies: deprecate setup.py and move to pyproject.toml#6971 [Riccardo]
      • Delayed
        • Rework OIDC user authentication #7310 [Dimitrios, James, Anil]
        • Create a new API endpoint for the clients to request tokens #6638[Dimitrios]
        • Implement new token authentication for download #7029[Dimitrios]
        • Support native json for Oracle DB when compatible version #7648child of #8011 [Dimitris]
        • Add startup self-check mechanism to block Rucio services when critical diagnostics fail #8197 child of #8011 [Dimitris]
        • Testing: Make tools/run_tests.sh idempotent #7737 child of #7667 [Dimitris]
        • Database: Ensure PostgreSQL ENUM types created during Alembic migrations honor the configured schema #8145 child of #7737 [Dimitris]
        • Rucio Python Client docstrings enhancement (Touchclient) #7844 child of #363 [Dimitris]
        • More useful client docstrings and CLI help messages (Target: 10/25) #363 [Dimitris]
        • Rucio support for full-structure metadata #8011 [Dimitris]
        • Rucio Python Client docstrings enhancement (Importclient) #7663 child of #363 [Dimitris]
        • Make available + Add to Notebook features failing #83 [Giovanni]
        • Token refresh after expiration #73 [Giovanni]
        • DIDs not being shown correctly in the extension after a successful download #95 [Giovanni]
        • Incorrect RSE shown in FTS Opensearch #7035 [Hugo]
        • Prevent multiple Reaper threads from working on the same replicas #6512 [Hugo]
        • Do not use regex to split did, use scope extraction method #7519[James]
        • Test stability on LTS branches #7964 child of #7667 [Karan]
        • API: rendering Enums in docstrings #587 [Maggie]
        • Rich CLI cannot display RSE information for some RSEs #7693child of #7225 [Maggie]
        • Generate "Configuration parameters" documentation page automatically, to avoid mismatches between documentation and code #325 [Maggie]
        • Adding a matching pattern for DIDs in list-rules command #7121[Maggie]
        • Change mixed prometheus_client and probe_metric approachs to use PrometheusPusher #129 [Maggie]
        • Migrate probes to use SQLAlchemy #165 [Maggie]
        • No way to check or change ownership of a scope using Rucio client #7830 [Maggie]
        • Document common.constant.RSEAttr #551 [Maggie]
        • Developer Guidelines for Reviews, Testing Requirements #538[Martin]
        • REST API: Add query parameter endpoint for listing accounts by identity to support OIDC identities with slashes #8159 [Mayank]
        • Simplify what we run on CI (test suites, OS, Python versions, DB, …) #7965 child of #7667 [Mayank, Karan]
        • [ EPIC: Release 39 ] : Mutation Operations and Role Based Access to pages/features #622 [Mayank]
        • Fix static code analysis behaviour for functions decorated with @transactional_session, @read_session and @stream_session #6986 [Riccardo]
        • session parameter in *_session decorated functions is required, but effectively treated as optional #6989 child of #6986 [Riccardo]
        • Rucio dependencies in test environments should be installed the same way they are installed when Rucio is installed as a package #344 child of #7667 [Riccardo]

       

      Ongoing retrospective tasks:

      • Clarify RSE settings vs. attributes -> Full move to attributes might be difficult
      • Implement a client release test procedure
      • Add/Clarify merging, code freeze, release logic, to the contribution guide
      • Investigate changes to merging policy, code freeze policy, and release logic
      • A clearer picture of the dependencies between components (which component relies on what?) -> Split into packages with pyproject files might help
      • Even more people could merge approved prs
      • More automation in our PR reviews (Closing of stale/unanswered PRs etc.)
      • We could close stale issues to decrease the backlog --> Need to look into that
      • Add review guidelines to the contribution guide (Testcases)
      • Need to be stricter during ticket review

       

      "Paused retrospective tasks (Should we still look into these?):

      • Review setup of development environment, make it easier to onboard developers -> have a generic version?
        • Barebones dev setup from readme in the rucio dev env
      • Improve documentation how to setup rucio in a non-k8s environment (Possibly with x509 certificates)
      • Documentation of how the config table vs cfg file works, and when which one should be used.
      • Documentation how to setup an RSE (for newcomers, and best practices)
        • CTAO can work on this
      • Formalise consistency guidelines for adding new RSE attributes, settings, commands, rest endpoints etc. (more discsssuion to follow)
        • CTAO can work on this
      • Investigate ways of introducing reviewers in parts of review
      • Be able to run all CI tests locally Side comment: Can be done with https://github.com/nektos/act already
        • issue #NNNN (Dimitris)
      • To have more informative logs for various exception cases: Needs tickets on these cases
      • Debug daemons using the dev environment [Inserting breakpoints, inspection of code, etc.]
        • Documentation on this? 
    • 15:45 → 15:55
      Developers roundtable 10m
      • Docusprint 2025
        • Thanks for participating!
    • 15:55 → 16:00
      AOB 5m