Rucio Development Meeting

Thursday 2 May 2019, 15:00 → 16:30 Europe/Zurich

4/S-056 (CERN)

Martin Barisits (CERN)

15:00 → 15:10 News

• Release plan
  • May 20: Rucio 1.19.8
  • May 27: Rucio 1.19.9
  • May 27: Rucio 1.20.0.rc1
    • Code freeze May 23rd 23:59 CEST
  • June 03: Rucio 1.20.0 "Wonder Donkey"
    • Rucio 1.20 will be our first LTS release line!
• Update to release model
  • There were no comments from the community to the proposal
  • Thus the proposed LTS release model will be implemented (effective immediately)
  • Rucio 1.20 will be our first LTS release line which will be supported ~ June-2019 to June-2021
  • Martin will create a respective page for the documentation and expand the github labelling for
• CERN-HSF accepted for GSOD
• CHEP Abstract submitted
  • Belle2, LIGO, SKA, CMS, ATLAS

15:10 → 15:30 News from the experiments

• CMS
  • Exploring DB configuration
    • Some success with DB side pooling
• ATLAS
  • More instrumentation on server side needed due to heavy queries
• LIGO
  • Own LFN2PFN algorithm

15:30 → 15:50 Hot topics

15:50 → 16:20 Developers roundtable

• 1.20.0 "Wonder Donkey" priority followup
  • Rucio mover
    • pcacheand storm symlinks
    • Some problems with pilot2
    • pcache has to be changed quite a bit, will be added later
    • storm protocol works when specified directly
      • Server filters storm protocol if not specified directly
      • Client needs to load protocols fail-save
  • Python 2.6 drop
    • Martin will do it soon #2460
    • Almost done
  • Reaper
    • Partitioning/Full heartbeat support of reaper #529
      • Need to protect storage 
        • Probably fine for dCache without protection
        • Probably not fine for all the others
        • One idea is to extend heartbeat to report the RSE the thread is working on
    • Relax protection of sources in reaper #1637
    • Fill contents history when deleting last replica #37
    • Archive Handling in the reaper #1431
    • Proposal: Google Doc
  • Get rid of unused dockers
    • Base client container
      • Notify clients next week and then remove community specific containers
      • Need to check if it is automatically build
      • Build an ATLAS rucio client based on the BASE Rucio client
      • Once done, tell XDC and Eiscat3D how to do theirs based on the BASE client
  • Migrate probes to separate repo #1638
    • PR including history is done
    • Will be switched on ATLAS machines with 1.20
  • Better way to deal with configuration/permissions #533
    • Mario wants to help!
  • Transparent handling of archives with rules #1091
    • Re-use of list_replicas code not really possible, needs to adressed se
  • Daemon to re-order tape requests (throttler) #2220
    • Added volume check
    • Problems with MySQL due to Window function
    • Will force to require mysql 8 for window functions
    • Will need a separate meeting to discuss the reading (writing is covered)

16:20 → 16:30 AOB