Rucio Development Meeting

Thursday 9 May 2019, 15:00 → 16:30 Europe/Zurich

4/S-056 (CERN)

Martin Barisits (CERN)

15:00 → 15:10 News

• New Indico Rucio theme!
• Rucio Coding Camp 2019
  • Please register
• GSOC student starting
  • Username/Password & SSO Login to WebUI
  • Follow Mode for DIDs
• Reaper 2.0
  • Decided for proposal (1) in offline discussion

15:10 → 15:30 News from the experiments

• ATLAS
  • All fine
• CMS
  • Job for collection replicas activated
  • Oracle optimization
  • Question from Frank:
    • Job classes (1 and 2) --> Confirm with Gancho
    • Jobs/Procedures --> App developer responsability
• ESCAPE
  • Setup ESCAPE instance (Based on info from Thomas)
  • Daemons running
  • FTS included; Transfers are running
  • MySQL DB on demand
• SKA
  • Host certificates on storage issues

15:30 → 15:50 Hot topics

15:50 → 16:20 Developers roundtable

• 1.20.0 "Wonder Donkey" priority followup
  • Rucio mover
    • pcacheand storm symlinks
    • Some problems with pilot2
    • pcache has to be changed quite a bit, will be added later
    • storm protocol works when specified directly
      • Server filters storm protocol if not specified directly
      • Client needs to load protocols fail-save
  • Python 2.6 drop
    • Martin will do it soon #2460
    • Almost done
  • Reaper
    • Partitioning/Full heartbeat support of reaper #529
      • Need to protect storage 
        • Probably fine for dCache without protection
        • Probably not fine for all the others
        • One idea is to extend heartbeat to report the RSE the thread is working on
    • Relax protection of sources in reaper #1637
    • Fill contents history when deleting last replica #37
    • Archive Handling in the reaper #1431
    • Proposal: Google Doc
  • Get rid of unused dockers
    • Base client container
      • Notify clients next week and then remove community specific containers
      • Need to check if it is automatically build
      • Build an ATLAS rucio client based on the BASE Rucio client
      • Once done, tell XDC and Eiscat3D how to do theirs based on the BASE client
  • Migrate probes to separate repo #1638
    • PR including history is done
    • Will be switched on ATLAS machines with 1.20
  • Better way to deal with configuration/permissions #533
    • Mario wants to help!
  • Transparent handling of archives with rules #1091
    • Re-use of list_replicas code not really possible, needs to adressed se
  • Daemon to re-order tape requests (throttler) #2220
    • Added volume check
    • Problems with MySQL due to Window function
    • Will force to require mysql 8 for window functions
    • Will need a separate meeting to discuss the reading (writing is covered)
    • For reading mode --> Need to add source_rse_id then Hannes development works already
    • PR is there, needs to be reviewed
• 1.20 repository cleanup (Lots of garbage)

16:20 → 16:30 AOB