Rucio Development Meeting

Thursday 21 Feb 2019, 15:00 → 16:30 Europe/Zurich

4/S-056 (CERN)

Martin Barisits (CERN)

1 News

• Rucio Workshop - 1 week left
  • 66 participants
• Funding at STFC to work on Multi-VO Rucio support
  • Plan will be presented/discussed at the Dev meeting
• Rucio journal paper almost ready
  • Accelerated ATLAS PubCom review was asked
  • Paper should be available for the Workshop!!!

2 News from the experiments

• ATLAS
  • Ongoing archive support and data carousel improvement
  • FTS
• CMS
  • No news
• SKA
  • New node in Australia
    • Will be added to full test-mesh

3 Hot topics

4 Developers roundtable

• 1.20.0 "Wonder Donkey" priority followup
  • Rucio mover
    • Commissioning
      • Slowly due to specific site problems
      • Problems with debug output
    • Storm protocol PR needs review
    • pcaches still needs development
  • Python 2.6 drop
  • Partitioning/Full heartbeat support of reaper #529
  • Relax protection of sources in reaper #1637
  • Fill contents history when deleting last replica #37
  • Archive Handling in the reaper #1431
  • Get rid of unused dockers
    • Base client container
      • Notify clients next week and then remove community specific containers
    • Oracle Instaclient is in the container - License allows this!
  • Migrate probes to separate repo #1638
  • Better way to deal with configuration/permissions #533
  • Transparent handling of archives with rules #1091
  • Daemon to re-order tape requests (throttler) #2220
    • Efficient query is key; 
    • Need to check if we need to modify bulk size
    • Need time to release per dest_rse column
    • Grouping strategy column
• Download client archive
  • Two bugs found in 1.18.9
    • wildcard download doesn't work if no filter is specified
    • Problems with downloads from containers
  • Overwrite priority in case of mixed streamed/client_extract replica
• Alembic upgrade scripts for postgres need special sql commands

5 AOB

• No Development meeting next week
• Possibly no Development meeting on Mar 7 (ATLAS Sites Jamboree)
  • Separate announcement will follow