Rucio Development Meeting

Thursday 11 Apr 2019, 15:00 → 16:30 Europe/Zurich

4/S-056 (CERN)

Martin Barisits (CERN)

15:00 → 15:10 News

• Reminder: Rucio Coding Camp 2019
  • Participate in the doodle
• Update to the Rucio Release Policy
  • Waiting for Community Comments
  • Proposal
• Meetings during Easter weeks
  • April 18th ?
  • April 25th CANCELLED
• ATTRACT proposals
  • Both proposals rejected, only very few software projects got through
• Several GSOC projects
  • Priority of students submitted
• Google Season of Docs
  • PR on HSF repository
  • Multiple proposals possible, but also multiple writers per proposal

15:10 → 15:30 News from the experiments

• ATLAS
  • CTA discussions
• CMS
  • Issues with number of connections - under discussion
  • httpd settings
  • DB settings
    • Send configuration used in ATLAS
    • Doubt from DBA side about amount of connections
• RAL/STFC
  • Multi-VO Rucio to Multi-VO DIRAC connection

15:30 → 15:50 Hot topics

15:50 → 16:20 Developers roundtable

• 1.20.0 "Wonder Donkey" priority followup
  • Rucio mover
    • pcacheand storm symlinks
    • Some problems with pilot2
    • pcache has to be changed quite a bit, will be added later
  • Python 2.6 drop
    • Martin will do it soon
    • #2460
  • Reaper
    • Partitioning/Full heartbeat support of reaper #529
      • Need to protect storage 
        • Probably fine for dCache without protection
        • Probably not fine for all the others
        • One idea is to extend heartbeat to report the RSE the thread is working on
    • Relax protection of sources in reaper #1637
    • Fill contents history when deleting last replica #37
    • Archive Handling in the reaper #1431
    • Proposal: Google Doc
  • Get rid of unused dockers
    • Base client container
      • Notify clients next week and then remove community specific containers
      • Need to check if it is automatically build
      • Build an ATLAS rucio client based on the BASE Rucio client
      • Once done, tell XDC and Eiscat3D how to do theirs based on the BASE client
    • Oracle Instaclient is in the container - License allows this!
  • Migrate probes to separate repo #1638
    • PR including history is done
    • Will be switched on ATLAS machines with 1.20
  • Better way to deal with configuration/permissions #533
    • Mario wants to help!
  • Transparent handling of archives with rules #1091
    • Re-use of list_replicas code not really possible, needs to adressed se
  • Daemon to re-order tape requests (throttler) #2220
    • Added volume check
    • Problems with MySQL due to Window function
    • Will force to require mysql 8 for window functions
• Pilot timeout issues - where do we stand
  • 1.19.5 version solved
• Repository cleanup
  • bin/  Should be fine
  • doc/
    • atlasnote/  - remove?
    • design/  - remove?
  • etc/
    • Some cleanup in the folder... netmodel... ?
    • auditor - needed?
    • docker
      • only keep demo and dev
    • schemas - json schemas - need to check if use
    • supervisord - remove or move to tools repo
    • web
  • lib/  ok
  • tools/ 
    • Lots of cleanup needed
    • Move things to tools repository?
  • tox.ini can go
  • Martin will do it.
• CHEP Deadline
  • Combined submission to CHEP

16:20 → 16:30 AOB