Rucio Development Meeting

Thursday 16 Jan 2020, 15:00 → 16:00 Europe/Zurich

53/R-044 (CERN)

Martin Barisits (CERN)

15:00 → 15:10 News

• Rucio Coding Camp at FNAL
  • https://indico.cern.ch/event/877322/
• Release schedule
  • Monday: 1.21.5
  • Thursday 1.21.6 (Special release including sharding simplifications)
    • There will be a merge freeze between Monday-Thursday to ensure that only the sharding feature is in 1.21.6

15:10 → 15:20 News from the experiments

• Belle 2
  • Belle 2 Computing Workshop discussed RAW data export test
    • Might impact ATLAS/CMS since it uses LHCONE
    • FTS at BNL
• ESCAPE
• ATLAS
  • Found issue with MultiHOP in Conveyor
    • Understood
  • Issues with src_rse_id filling and evaluatur
    • See Hot Topics
• DUNE/James

15:20 → 15:30 Hot topics

• Source_rse_id filling for Throttler
  • Source_rse_id filling does not scale well
• Judge Evaluator
  • Problematic due to blacklisting not done on a SQL query level
  • Backlogs not processed properly
• Google Summer of Code projects
  • Don't need to discuss all today, but latest next week
  • NLP from Tomas for OpInt
  • Integration of some other WorkflowMgmt system
  • WebUI 2.0?

15:30 → 15:55 Developers roundtable

Rucio_Issue_burn_2020-01-16.png

Rucio_priority_progress_2020-01-16.png

• Issue burn update
• Rucio 1.22 "Green Donkey" priority development followup
  • In Progress
    • Kubernetes [Thomas]
      • Still waiting for the new network controller
      • Eric re-worked the probes to use jobber as a probe controller
      • Jaroslavs AAI development to be deployed on DOMA instance
    • Reaper 2.0 #2412 [Cedric, Thomas]
      • It's essentially done, a few things need to be improved
      • Query to get list of unlocked replicas needs to be improved
    • OIDC #2612 [Jaroslav]
    • MultiVO #2635 [Ian, Andrew]
      • Further development when Eli starts
      • Need to consider Non-Multi-VO deployments with these changes
    • RSEMgr v2.0 #3147 [Tomas, Tobi]
      • Waiting on review & merge of one iteration
    • Unification of metadata #3096 [Aris]
      • Ongoing
    • General update of BB8 #3148 [Tomas, JJ, Dimitrios]
      • No news
      • Some comments on the PR would be helpful
      • Possibly a candidate to move to next Feature?
    • Cleanup of Issues [Everyone]
      • Update tickets
      • Next week deadline
  • ToDo
    • Data Pre-Placement [Thomas]
    • Documentation [Martin]
    • rucio.cfg vs config table #2630 [Mario]
    • Versioned history tables need explicit definition #2063 [Martin]
    • Protection of sources too strict in reaper #1637 [Cedric, Thomas]
    • Add file to content history in reaper #37 [Cedric, Thomas]
    • Reaper should stop in case of judge backlog #1578 [Martin]
    • Handling of Archives in Reaper #1431 [Cedric, Thomas, Mario, Martin]
    • Missing features for Archives #1091 [Mario, Martin]
    • Documentation page listing config table and RSE attributes #2631 [Mario]
    • Operators doc and repo #2636 [Martin]
  • Done
    • Repository cleanup #5252 [Martin, Thomas]
    • Configuration / Permissions / Policy #533 [James]
• Auditor
  • Contacted by CMS who want to continue on Auditor work
  • Dimitrios and Thomas will try to give pointers, probably should re-write some parts of the auditor into an auditor2

15:55 → 16:00 AOB