Rucio Meeting

Thursday 20 Apr 2023, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

15:00 → 15:05 News

• 1:1 Ticket review
  • eMail to component leads going out soon
• Reminder: May 4 
  • Python 3.6 deprecation meeting

15:05 → 15:25 Community News & DevOps roundtable

• ATLAS
  • Running 1.31.1.
  • FTS VOMS proxy renewal:
    • Some missing certificate package(s) in the container image?
  • Cluster storage utilisation:
    • Still under investigation.
    • Apache error_log growing too large.
      • Possibly exclusively due to traces?
    • ATLAS is no longer restarting pods nightly.
  • Putting a lot of load (over 1M request) on the Conveyor-Preparer:
    • Spike in DB utilisation.
  • CERN (CTA) and FZK-LCG2 (dCache) tape now use WebDAV and the tape REST API exclusively for all operations.
• CMS
  • NTR
• Fermilab / DUNE / ICARUS / RUBIN
  • DUNE
    • Imminent use of Metacat/Rucio instead of SAM.
• BELLE II
  • Preparation for Python 3 migration.
• ESCAPE
  • Working on Rucio Jupyterhub extension on new setup
    • OIDC for authentication, not quite working (#20)
  • Monitoring messages from Hermes to Grafana dashboard
    • Missing deletion_done events?

15:25 → 15:55 Developers roundtable

Progress-2023-04-20.png

• 32 "The Good, The Bad and the Donkey" Priority followup
  • In Progress
  • In Review
    • Unable to Delete File DID via Undertaker #5154 [Anton]
  • Todo
    • Create Pages for Create Rule Workflow #w/144 [Anton]
    • Replace all instances of X509 identities presented in the legacy format #6182 [Dimitrios]
    • Design and implement a token request module #6187 [Dimitrios]
    • Incorporate IAM-based testing for token workflows #6188 [Dimitrios]
    • Design and implement a token cache module #6183 [Dimitrios]
    • Adapt probes to rucio/rucio#5804 #p/108 [Eric]
    • Kick off SIG-Tokens [Martin]
    • Document and cleanup discrepancies between surl and lfn2pfn algorithms #5129 [Martin]
    • Reduce core tickets <15 [Martin, Mario]
    • foreign key error on deleting dids in reaper #5733 [Martin]
    • Create a server/daemon installation howto #d/178 [Mayank]
    • Create developers testing guide in the documentation #d/177 [Mayank]
    • Support OIDC login #w/149 [Mayank]
    • Migrate List My Rules and Rule View to clean architecture #w/159 [Mayank, Anton]
    • Migrate Dashboard to Clean Architecture #w/158 [Mayank, Anton]
    • Migrate DID and DID-metadata view to clean architecture #w/160 [Mayank, Anton]
    • Exchange of function-based indices with normal index #6143 [Radu]
    • Internal transfer monitoring #6189 [Radu]
    • New dispatcher logic for conveyors #6190 [Radu]
    • Update/Re-design core.meta module #5224 [Rob]
  • Done
  • Delayed
• Documentation corner
  • Document environmental variables affecting the client #171 [Dimitrios]
  • Documentation and dev guidelines for MyPi type annotations #116 [Mayank, Martin]
  • Create developers testing guide in the documentation #177 [Mayank]
  • Create a server/daemon installation howto #178 [Mayank]
  • Improve documentation on rucio.cfg vs configuration table #183 [Radu]
  • Add an FAQ-style entry aimed at users for STUCK rules #184 [Fabio]
  • Add instruction about DB partitioning #185 [Martin]
  • bridge the gap between running rucio in demo env and full production deployment #187 [Radu]
  • Introduce documentation on subscriptions #190 [Cedric]
  • improve documentation about --distance and --ranking and source ranking #199 [Radu]
• Other topics
  •  

15:55 → 16:00 AOB