Rucio Development Meeting

Thursday 25 Mar 2021, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

15:00 → 15:10 News

• Google Summer of Code
  • Now in Proposal writing phase for students
• CERN Summer Students
  • Got one student
• April Meeting schedule
  • Apr 1
  • Apr 8
  • Apr 15
  • Apr 22
  • Apr 29

15:10 → 15:20 Community News & DevOps roundtable

• ATLAS
  • Loadbalancer issue (CERN)
    • Loadbalancer as a service, constantly failing today, before also 2-3 times a week
    • CMS, ESCAPE, DOMA deployment a bit different, don't see this issue
  • Clients
    • Some issues with the clients, fixed, nothing widespread
• CMS
  • Re-do integration server
    • 1.25 to test GO stuff
    • Done with a new K8s cluster
      • Want to use new prometheus monitoring
    • Will receive specific test workflows
      • Some read-only RSEs, some specific write RSEs
• Fermilab
  • Tutorial for Icarus on Rucio
• Belle II
  • WebUI still not able to deploy
    • Client certificate not requested
      • Mismatch of CA authority and Client/Server certificate?
  • Will start to look at traces
  • Metadata reporting via AMGA
    • Aggregated metadata
      • Should be put into metadata plugin interface
• LDMX
• RAL / MultiVO
• ESCAPE
• SKA
  • Finalizing K8s deployment

15:20 → 15:30 Hot topics

15:30 → 15:55 Developers roundtable

Testing Software in Rucio.pdf

Rucio 1.26 "Donkey League of La Mancha" priority followup

• In Progress
  • Test and switch to new rule algorithm #4215 [Martin]
    • 3 rounds of testing in ATLAS, all fine
    • Switch as default NOW in 1.26
  • Migrate documentation to new docusaurus [Martin, Ben, Daniel]
    • Working on GH actions
  • Logging Review #4220 [All Component leads]
• Todo
  • Test SSO Login [Rizart]
  • Re-Factor Transfer workflow [Radu]
  • Switch to policy-packages as default [James, Martin]
  • Hermes2 planning
  • Discuss and plan mysql5 deprecation [Mario]
  • Test Import and Export of CRIC JSON [Rizart]
  • Versioned history tables #2063 [Martin]
  • Python 3.8 and 3.9 testing #4453 [Ben]
  • Remove webpy endpoints and dependency #4044 [Ben]
  • Auditor overhaul #3437 [Dimitrios, Eric] 
  • Rename reaper2 to reaper #4462 [Martin]
  • Setup.py and requirements overhaul #4456 [Ben]
  • Cleanup tickets #4463 [*]
  • rucio.cfg vs Config table #2630 [Mario] 
• Done
• Delayed
  • QoS #3419 [Mario, Martin, Rizart]

Developer roundtable

• Integration testing
  • PR for the upload client test 
    • Integrating new Testing features which have been added by Ben and Radu
    • Should work both with MOCK RSE + Containerized RSEs
  • TPC
    • Need to re-factor tests
    • By next meeting
• Testing
  • Ben gave a presentation on Monday to ATLAS computing
  • Presentation attached
• Everyone welcome to review PRs!

15:55 → 16:00 AOB