Rucio Meeting

Thursday 21 Sept 2023, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

15:00 → 15:05 News

• DIRAC & Rucio workshop - Registration now closed!
• Suggest release names for the 2024 Rucio releases
  • See mattermost dev channel

15:05 → 15:25 Community News & DevOps roundtable

• ATLAS
  • Share injection tool for the DC*
    • Maybe put it to https://github.com/rucio/tools
  • --deep test running for a week continuously
    • Continous to look good!
• CMS
  • Running 32 on INT
    • Seems ok
    • Some initial permission problems
  • Moving to 32 in PROD next week
    • Clients on 1.29
      • Legacy client compatibility: https://rucio.cern.ch/documentation/started/releasepolicy#client--server-compatibility
• Fermilab & Co
  • 32 deployment overhaul
    • mu2e to upgrade first
    • then others
  • Scratch / cache storages
    • To look into rucio-cache-consumer
  • RUBIN
    • Sizable test for data movement
      • Should check entire stack (wfms, rucio, etc.)
        • Will not include metadata
• DUNE
  • rucio-consistency enforcement
    • DUNE wants to start looking at :-) using it
    • Should be based on the CMS contribution to core rucio
      • But some adaption might be needed
      • Would be a good moment for ATLAS to look into this as well
  • After Rucio workshop, add DUNE users to Rucio
    • Handle usecase for users without fermilab account
      • Handle them via CERN users?
• Belle II
• ESCAPE / EOSC-Future
  • Migrate to 32 (Still on 1.30)
  • No problems for now :-)
  • reana connection works flawlessly now
    • Fully documented
• MVO
  • Moving to v32
• ALTO
  • Visualisation work 
    • requests visualisation issue #
  • Also working on #6189

15:25 → 15:55 Developers roundtable

Progress-2023-09-21.png

• Rucio 33 "Eternal Sunshine of the Donkey's Mind" roadmap
  • In Progress
    • Design and implement a token cache module #6183 [Dimitrios]
    • Introduce the RSE decommissioner daemon #6321 [Yutaro, Dimitrios]
    • WebUI Release 33 page tracker (4/14) #301 [Mayank/Anton]
      • Linked DID, RSE, list_rse page
      • In progress list_subscription, subscription page 
      • dashboard need to check if we need to expand Rucio REST endpoints
    • Transfer status visual representation #6189 [Radu, Jensen]
    • Dynamic distance between RSEs #5012 [Radu, Jensen]
    • revisit submitter source selection strategy #5776 [Radu, Jensen]
  • In Review
    • Unable to Delete File DID via Undertaker #5154 [Anton]
    • Incorporate IAM-based testing for token workflows #6188 [Eraldo, Dimitrios]
  • Todo
    • Design and implement a token request module #6187 [Dimitrios]
    • Document and cleanup discrepancies between surl and lfn2pfn algorithms #5129 [Martin]
    • foreign key error on deleting dids in reaper #5733 [Martin]
    • Review state of the Light Reaper #6317 [Martin]
    • Review lost data handling (replica-recoverer) [Martin]
      • Open an issue from the discussion [Cedric]
      • Monitoring the suspicious replicas would be helpful
        • Fabio put together a grafana panel
    • Tests cleanup [Radu] #6212
    • scitags/packet marking support #5856 [Radu]
  • Done
• Documentation corner
  • Fix: Adding Missing Menu Entry for Notifications section #252 [Eraldo]
  • Documentation and dev guidelines for Mypy type annotations #116 [Mayank, Martin]
  • Document environmental variables affecting the client #171 [Dimitrios]
  • Improve documentation on rucio.cfg vs configuration table #183 [Radu]
  • Add an FAQ-style entry aimed at users for STUCK rules #184 [Fabio]
  • Add instruction about DB partitioning #185 [Martin]
  • bridge the gap between running rucio in demo env and full production deployment #187 [Radu]
  • Introduce documentation on subscriptions #190 [Cedric]

15:55 → 16:00 AOB