Name: Rucio Meeting
Start: 2023-11-16T15:00:00+01:00
End: 2023-11-16T16:00:00+01:00
Location: No location set

15:00 → 15:05

News 5m

Reminder: 33 "Eternal Sunshine of the Donkey's Mind"
- Code-Freeze Nov-27
- 33.0.0.rc1 Nov-29
- 33.0.0 (final) Dec-04

15:05 → 15:25

Community News & DevOps roundtable 20m

DC24 workshop
- 2-day workshop Thu & Fri last week
  - Road to DC24
  - Experiments, Storage providers, Networks, Tokens
ATLAS
CMS
- Ready to move auth-servers to 32
- 33 deployment plan
  - Relatively quickly in December
Fermilab
- DUNE
  - Random oidc errors on server?
    - Rebooting helped
    - oidc not enabled
  - Ramping up scale
    - Increasing wsgi connections
  - Large rules killing judge-evaluator
    - Martin will answer Steve on this
- mu2e
  - Ready to integrate
- Moving more experiments to Rucio
- RUBIN
  - Configure automatix
    - Issues with scope/name regexp (Due to RUBIN naming scheme?)
  - -> RUBIN policy package
  - FTS3 throughput issues with SLAC fts3 (Mihai is helping)
    - gfal checksum calculation on sending files
    - Too many connections issue?
- Moving everyone to 32
Belle 2
ESCAPE/EOSC
- Development cluster to test version changes deployed
  - 32 deployed
  - Integrating cloud RSEs
    - CESNet S3
DUNE/Edinburgh
- PR to enable auditor on object stores
- New abstract Class for Algorithms/Plugins
  - Integrate more code to this class
- DUNE VO-specific tests
  - metacat containers available
ALTO
- transfer monitoring working version with new request api (metrics - Rucio REST API)
- Start working with the existing schema, will not change in significant way
RAL / MultiVO

15:25 → 15:55

Developers roundtable 30m

Rucio 33 "Eternal Sunshine of the Donkey's Mind" roadmap
- In Progress
  - Design and implement a token cache module #6183 [Dimitrios]
    - Things on track
      - Cache largely done
      - Request module
        adaption in submitter and reaper
      - Authentication flow issue
        Client credential grant workflow issues
  - Design and implement a token request module #6187 [Dimitrios]
  - Introduce the RSE decommissioner daemon #6321 [Yutaro, Dimitrios]
  - WebUI Release 33 page tracker (4/16) #301 [Mayank, Eraldo]
    - Most items done
    - Dashboard endpoint might not be ready for 33
    - Create rule workflow very complex
      - Works, but needs to be integration tested
    - WebUI Container should be there too
  - Transfer status visual representation #6189 [Radu, Jensen]
    - Statistics gathering code is being tested in ATLAS
    - Table view is done, graph view needs to be implemented
  - Dynamic distance between RSEs #5012 [Radu, Jensen]
- In Review
  - revisit submitter source selection strategy #5776 [Radu, Jensen]
- Todo
  - Document and cleanup discrepancies between surl and lfn2pfn algorithms #5129 [Martin]
- Done
  - Incorporate IAM-based testing for token workflows #6188 [Eraldo, Dimitrios]
  - Review state of temporary dids (and thus Light Reaper) #6317 [Dimitrios]
  - Review lost data handling (replica-recoverer) [Martin]
  - scitags/packet marking support #5856 [Radu]
  - Simplify the test pipeline [Radu] #6212
Documentation corner
- Documentation and dev guidelines for Mypy type annotations #116 [Mayank, Martin]
- Document environmental variables affecting the client #171 [Dimitrios]
- Improve documentation on rucio.cfg vs configuration table #183 [Radu]
- Add an FAQ-style entry aimed at users for STUCK rules #184 [Fabio]
- Add instruction about DB partitioning #185 [Martin]
- bridge the gap between running rucio in demo env and full production deployment #187 [Radu]
- Introduce documentation on subscriptions #190 [Cedric]
- Versioning Issue in generate_release_notes_index.py #247 [Anton]
- WebUI: Improve Docs #255 [Anton]
- Add instructions for Mac Apple Silicon in the developer section #261 [Eraldo]
  - PR there
- list_file replicas usage #6333 [Eraldo]
  - PR there
Other topics
- Nightly autotest build is failing, Mayank having a look

15:55 → 16:00

AOB 5m