Rucio Development Meeting

Name: Rucio Development Meeting
Start: 2019-04-11T15:00:00+02:00
End: 2019-04-11T16:30:00+02:00
Location: CERN

Thursday 11 Apr 2019, 15:00 → 16:30 Europe/Zurich

4/S-056 (CERN)

4/S-056

CERN

Show room on map

Martin Barisits (CERN)

- 15:00 → 15:10
  News 10m
  Reminder: Rucio Coding Camp 2019
  
  Participate in the doodle
  
  Update to the Rucio Release Policy
  
  Waiting for Community Comments
  
  Proposal
  
  Meetings during Easter weeks
  
  April 18th ?
  
  April 25th CANCELLED
  
  ATTRACT proposals
  
  Both proposals rejected, only very few software projects got through
  
  Several GSOC projects
  
  Priority of students submitted
  
  Google Season of Docs
  
  PR on HSF repository
  
  Multiple proposals possible, but also multiple writers per proposal
- 15:10 → 15:30
  News from the experiments 20m
  ATLAS
  
  CTA discussions
  
  CMS
  
  Issues with number of connections - under discussion
  
  httpd settings
  
  DB settings
  
  Send configuration used in ATLAS
  
  Doubt from DBA side about amount of connections
  
  RAL/STFC
  
  Multi-VO Rucio to Multi-VO DIRAC connection
- 15:30 → 15:50
  Hot topics 20m
  - Authentication and Authorisation evolution proposal 20m
    
    Speaker: Mario Lassnig (CERN)
    
    Still very much WIP
    
    https://docs.google.com/document/d/1h_JuXyhM13xw2gm0zK-eYuS0zcCH5H-GwWPXI9ZoSY8/edit?usp=sharing
    
    Mario finalizes document (May) --> Will be circulated internally then for comments, then communicate to WLCG Auth
- 15:50 → 16:20
  Developers roundtable 30m
  1.20.0 "Wonder Donkey" priority followup
  
  Rucio mover
  
  pcache~~and storm symlinks~~
  
  Some problems with pilot2
  
  pcache has to be changed quite a bit, will be added later
  
  Python 2.6 drop
  
  Martin will do it soon
  
  #2460
  
  Reaper
  
  Partitioning/Full heartbeat support of reaper #529
  
  Need to protect storage
  
  Probably fine for dCache without protection
  
  Probably not fine for all the others
  
  One idea is to extend heartbeat to report the RSE the thread is working on
  
  Relax protection of sources in reaper #1637
  
  Fill contents history when deleting last replica #37
  
  Archive Handling in the reaper #1431
  
  Proposal: Google Doc
  
  Get rid of unused dockers
  
  Base client container
  
  Notify clients next week and then remove community specific containers
  
  ~~Need to check if it is automatically build~~
  
  Build an ATLAS rucio client based on the BASE Rucio client
  
  Once done, tell XDC and Eiscat3D how to do theirs based on the BASE client
  
  Oracle Instaclient is in the container - License allows this!
  
  ~~Migrate probes to separate repo #1638~~
  
  ~~PR including history is done~~
  
  ~~Will be switched on ATLAS machines with 1.20~~
  
  Better way to deal with configuration/permissions #533
  
  Mario wants to help!
  
  Transparent handling of archives with rules #1091
  
  Re-use of list_replicas code not really possible, needs to adressed se
  
  Daemon to re-order tape requests (throttler) #2220
  
  Added volume check
  
  Problems with MySQL due to Window function
  
  Will force to require mysql 8 for window functions
  
  Pilot timeout issues - where do we stand
  
  1.19.5 version solved
  
  Repository cleanup
  
  bin/ Should be fine
  
  doc/
  
  atlasnote/ - remove?
  
  design/ - remove?
  
  etc/
  
  Some cleanup in the folder... netmodel... ?
  
  auditor - needed?
  
  docker
  
  only keep demo and dev
  
  schemas - json schemas - need to check if use
  
  supervisord - remove or move to tools repo
  
  web
  
  lib/ ok
  
  tools/
  
  Lots of cleanup needed
  
  Move things to tools repository?
  
  tox.ini can go
  
  Martin will do it.
  
  CHEP Deadline
  
  Combined submission to CHEP
- 16:20 → 16:30
  
  AOB 10m