Rucio Meeting

Thursday 5 Dec 2024, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

1 News

• December meeting schedule
  • Dec-05
  • Dec-12
  • Dec-19
  • Dec-26 CANCELLED
  • First meeting in 2025: Jan-09
• December release schedule
  • 36 final next week
  • Dec-16 36.?
  • Dec-16 32.8.4 LTS
• DIRAC & Rucio mini workshop & hackathon
• 37 "Dungeons & Donkeys" release roadmap planning on Dec-19

2 Community News & DevOps roundtable

• ATLAS
  • 36.0.0rcN (N=5 at the moment) deployment
    • Finally running, will monitor until Monday for a final decision
  • rc5 client install for rich-client
    • Great improvement, especially with the upcoming client restructure
    • -> Need to add this to the release notes (Important changes)
• CMS
  • Issues with the finisher
    • A few times a day it goes to 4-6 gb of memory usage
    • Not a big problem at the moment, but still noticable
  • Deletion patch
    • #7199 being tested in CMS at the moment, together with the token based changes
      • The two are conflicting, needs to be checked
• Fermilab DUNE/RUBIN/...
  • Trying to understand tape RSEs
    • davs protocol + wlcg tape rest api WORKS
  • RUBIN hermes issue understood
    • Tim added a PR with a fix
  • async rule injection
    • Going slowly with very slow queries
      • Updated some memory parameters, which improved the situation
  • preparer not used yet, but might be good to look into
  • receiver would be more important
• DUNE
• EIC
• DaFab
  • Investigating new postgres driver (psycopg3)
  • Investigating windows Rucio clients
• ESCAPE
  
  • More news next year
• DUNE / Edinburgh
  • Token tests with CiLogon and TPC
    • Running successful with Dimitrios script 
    • Running successful with Anils script
    • FTS compliance script next
    • Next Rucio instance with CiLogon and FTS

3 SIG Tokens monthly update

Speaker: Dimitrios Christidis (CERN)

2024.12.05 Exploring an Alternative Model for Tokens.pdf

rucio_auth_token.pdf

• Token tests with CiLogon and TPC
  • Running successful with Dimitrios script 
  • Running successful with Anils script
  • FTS compliance script next
  • Next Rucio instance with CiLogon and FTS

4 Rucio 36 release retrospective

Speaker: Martin Barisits (CERN)

Rucio 36 release retrospective

• Items from 35 release retrospective
  • Plan a documentation hackathon ✅
  • Documentation corner: Make it mandatory to add 1-2 items per release roadmap ✅
  • Investigate documentation on configuration of tape storage elements: e.g. srm vs other protocols, archive timeout, copy_pin_lifetime, bring_online, etc. - Just more detail in how to handle tape RSEs
    • Ongoing in DocuSprint24
  • Improve CI testing framework (Be able to run GH actions locally?)
  • Test coverage, test quality ✅
  • More support for cloud RSES and cost control ✅
  • Evolve the roadmap mechanism (sprints…)
    • Planned for 37 release
  • Investigate how to propagate information on deprecation of certain modules/functionality (e.g. C3PO, OIDC modules, etc.)

5 Developers roundtable

• (Riccardo) richclient - should it go with the other clients in the client folder, or renamed to richconfig, or something else?
  • Should be part of the baseclient eventually
  • Broke client documentation generation, since it is not a real client (Has been resolved)
    • pydoc generation also updated
• (Riccardo) for docstring consistency - we have authors at the top of some filenames; do we want that or not? e.g. at top of rucio.cfg.template
  • No, should be removed
• (Mayank) New webui: 36.0.0 release is done
  • Some testing needed for x509 with all combinations of OS/browsers, which might require a small update, but in general it should work
  • Please test!

6 AOB