Rucio Meeting

Thursday 25 Jan 2024, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

15:00 → 15:05 News

• Token leak in FTS/XrootD logs
  • FTS increased verbosity of their logs, logs accessible to anyone from CERN
  • xrootd based storages (Except EOS) affected
  • Redirect step (FTS connected to storage head-node, gets redirected to different URL)
    • xrootd puts redirect URL (including the bearer token) into the log
  • -> Anyone who has access to the log has access to the token
  • Tokens have limited lifetime, though scope might have a storage.modify token which could delete the entire storage
  • ATLAS response
    • Switched off token support for affected sites
  • FTS put restrictions to who can view logs (Only very specific subset of users can)
  • DC24
    • Should we add these sites or not?
  • Nothing todo for Rucio
• February meeting schedule
  • Feb 01
  • Feb 08
  • Feb 15 (DC24)
  • Feb 22 (DC24)
  • Feb 29

15:05 → 15:25 Community News & DevOps roundtable

• ATLAS
  • FTS/xrootd Token leak issue (see news)
  • Running latest release (33.3.0)
  • Increasing sites with token support
• CMS
• Fermilab DUNE/RUBIN
• Belle II
  • pre-DC24 test
    • Managed to reach level of target export!
• ESCAPE++
  • 1.30 -> 33 planned
  • Token issue might also affect ESCAPE
• Edinburgh DUNE
  • Meeting at CERN
  • Highest priority: DUNE specific VO tests
    • Modeled on integration tests (Will need a metacat container)
  • Also important: DUNE, QoS, Globus transfertool
• ALTO
  • Testing topology view of transfer monitoring
    • Depends on PR for table views (not merged yet)
  • Now IETF working group
    • https://datatracker.ietf.org/wg/nmop/about/
• RAL / MultiVO

15:25 → 15:55 Developers roundtable

Progress-2024-01-25.png

• Rucio 34 "Donkey Potter and the Data Cache" roadmap
  • In Progress
    • foreign key error on deleting dids in reaper #5733 [Alex]
    • factorize duplicate messaging code into a common module or class #6423 [Alex]
    • Continue migration to SQLAlchemy 2.0 syntax #6057 [Erling]
    • Update/Re-design core.meta module #5224 [Maggie, Rob]
    • Deployment and Release Workflow #401 [Mayank, Eraldo]
      • 33.ALPHA tagged
        • Will still need a reverse proxy
        • Helm charts being worked on
    • Missing WebUI Release 33 page tracker #301 [Mayank, Eraldo]
    • Unable to Delete File DID via Undertaker #5154 [Riccardo]
    • Type annotate the code #6454 [Riccardo]
  • In Review
    • Refactor policy package algorithm code #6382 [James]
    • Metadata for tape co-location and transfer prority #6398 [Maggie]
  • Todo
    • Update extension for v32 (and higher) compatibility #25 [Francesc, Enrique]
    • Migrate Dashboard to Clean Architecture #158 [Mayank, Eraldo]
    • bridge the gap between running rucio in demo env and full production deployment #187 [Radu, Enrique]
  • Done
    • Add Token based TPC tests to the CI #6451 [Radu]
  • Delayed
• Documentation corner
  • Documentation and dev guidelines for Mypy type annotations #116 [Mayank, Martin]
  • Document environmental variables affecting the client #171 [Dimitrios]
  • Improve documentation on rucio.cfg vs configuration table #183 [Radu]
  • Add an FAQ-style entry aimed at users for STUCK rules #184 [Fabio]
  • Add instruction about DB partitioning #185 [Martin]
  • bridge the gap between running rucio in demo env and full production deployment #187 [Radu]
  • Introduce documentation on subscriptions #190 [Cedric]
  • WebUI: Improve Docs #255 [Eraldo]
  • Add instructions for Mac Apple Silicon in the developer section #261 [Eraldo]
    • Under Review
  • Add Rucio QoS RSE description and instructions #268 [Matt]
    • Under Review
• Other topics
  •  

15:55 → 16:00 AOB