Rucio Development Meeting

Thursday 20 Jun 2019, 15:00 → 16:30 Europe/Zurich

4/S-056 (CERN)

Martin Barisits (CERN)

15:00 → 15:10 News

• No development meeting next week!
• Produced Hotfix release 1.20.1.post1
  • Due to error in conveyor-submitter
• Rucio Journal Paper accepted at CSBS
• Rucio Evaluation paper accepted at CHEP
  • Who will present?
    • Mario will present

15:10 → 15:30 News from the experiments

• ATLAS
  • Preparation for the software week
• CMS
  •  Adding tape sites
    • Some sites need to set tape families, other sites do not care about it; How does ATLAS do it?
      • Could use add-rule --ask-approval mode to hold rule back (on RSE with no quota)
• DUNE
  • Nothing new
• ESCAPE
  • No news

15:30 → 15:50 Hot topics

15:50 → 16:20 Developers roundtable

• Rucio 1.21 priority followup
  • Focus
    • Cleanup & Stability
    • Documentation
    • Deployment (Kubernetes!)
  • Open ID connect #2612
    • Probably have to update length of columns?
    • Increase size of the token_column and add concept of token_type
  • Rucio.cfg vs Rucio config table cleanup #2630
    • Will try to collect and make a meeting to decide
  • History table definition explicitly (No Versioned models) #2063
  • MultiVO features #2635
  • Reaper 2.0 #2412
    • Relax protection of sources #1637
      • More complicated than we thought;
    • Fill contents history when deleting last replica #37
    • Archive Handling in Reaper #1431
    • Reaper protection in case of Judge-Evaluator backlog #1578
    • First PR is there; Had some discussion and need some changes
  • Documentation for configuration parameters #2631
  • Operators documentation / recipes #2636
  • Expand Kubernetes usage
    • New cluster started last week
    • conveyor-submitter,poller,finisher and undertaker are now running
      • Monitoring pages available
      • Plan is to start more as well
  • Tracking what happened with a did #2637
    • In progress; Some code from the coding camp, but needs to be continued
  • XCache config table population add to probe #2638
    • Needs to be commited
  • BB8 Needs better configuration and get rid of hard-coded entries
  • Better way to deal with configuration/permissions (entry point, configuration.py, …) #533
  • Transparent handling of archives with rules #1091
  • Global Quotas #2315
  • Possibility to inject rules delayed #2639
  • Improve oracle test crashes #2588
    • Some improvements, unclear if it helped
  • Python 3.5 for server
    • pystatsd does not support Python3
      • Change to statsd possible
    • Postgres issue with byte and text data
  • Python 3.6 for clients
    • Should be compatible, but something missing in the tests
  • Changes for CTA transfer handling #2632
    • Non trivial, still needs to be discussed
  • Source throttling #2611
    • Almost done; Need to add src_rse_id
    • Now using rse_transfer limits table
    • Will need schema change as well
  • Activity exclusion for submitter #2640​​​​​​​

16:20 → 16:30 AOB