Rucio Meeting

Thursday 16 Feb 2023, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

1 News

• Next week no Rucio meeting!
• March meeting schedule
  • March 02
  • March 09
  • March 16
  • March 23
  • March 30
• Reminder: Move to Mattermost!

2 Community News & DevOps roundtable

• ATLAS
  • Latest release running
  • Test with posix protocol
    • For now succesful
  • #5963 lfn to pfn for file: protocol returns localhost in the path
    • Does anyone use file://... urls?
      • Possibly some tools who require it
        • Not required for gfal
      • We can check if something still uses it, but if gfal does, then we opt for the new implementation?
  • #5460 DownloadClient creates protocol using the WAN domain only
    • Add domain in the call
• CMS
  • Starting 1.30 upgrade
  • Dimitrios: Any issues with the probes on upgrade (ATLAS did)?
• Fermilab / DUNE / RUBIN
• DUNE
• ESCAPE
  • New VRE cluster setting up
  • Possible to get fts-job ids from rule_id (On WebUI yes, on CLI possibly not)?
  • Use VRE cluster for DOMA testing as well
    • Yes, need to meet about details
    • Martin will send emails
• InterTwin
• MultiVO / RAL
  •  

3 Developers roundtable

Progress-2023-02-16.png

• 1.31 "Donkeys of the Caribbean" Priority followup
  • In Progress
    • Create ongoing token architecture document [Dimitrios]
    • Increase WebUI Test coverage [Mayank]
      • Working on end to end tests and adding to CI
    • Collect feedback from running ATLAS webui beta [Mayank]
    • Move WebUI Core to Clean + Hexagonal Architecture + Domain Driven Design #117 [Mayank]
      • Session and sessin mgmt done
      • data streaming currently worked on
      • George helping with MultiVO webui part
    • Merge list_dids and list_dids_extended methods #5448 [Rob]
    • Track SQLAlchemy 2.0 migration progress [Yuyi, Martin]
      • Martin will check with Yuyi
    • Reduce rule tickets to <13 [Martin, Anton]
  • In Review
    • Rules on containers in state OK but not all the files from the containers have locks #5447 [Anton, Martin]
    • Unable to Delete File DID via Undertaker #5154 [Martin, Anton]
    • WebUI release process #121 [Mayank]
  • Todo
    • Exchange of tombstone function-based indices with normal indices #5440 [Martin]
    • Create developers testing guide in the documentation #5452 [Mayank, Radu]
      • Radu can work on IntelliJ setup
    • Replace hermes1 by hermes2 [Mario, Cedric] -> ticket
      • Rename hermes1 -> hermes_legacy
      • hermes2 -> hermes
      • Need to check with Mario, Cedric
  • Done
    • Add python 3.10 tests to CI framework. #5145 [Mayank]
    • STOMP connections not closed by Hermes? #5894 [Eric, Yuyi]
      • Simulation with hermes and could not trigger connection problem
      • Needs more investigation
      • This one can be closed, but Kronos does make connection issues
  • Delayed
    • Create a server/daemon installation howto #5445 [Mayank]
    • foreign key error on deleting dids in reaper #5733 [Martin, Cedric]
• Documentation corner
  • Ambiguity of "developing" and "developer" #25 [Eraldo]
  • Document environmental variables affecting the client #171 [Dimitrios]
  • Documentation and dev guidelines for MyPi type annotations #116 [Mayank, Martin]
  • Create developers testing guide in the documentation #177 [Mayank] [1.31 priority]
  • Create a server/daemon installation howto #178 [Mayank]
• Other topics
  • RSE Protocol re-order - gap closing
    • #6083
    • Take it out
    • Add an option where you can add a "sort-protocols-for-RSE"

4 AOB