Rucio Meeting

Thursday 26 Aug 2021, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

15:00 → 15:05 News

• CHEP'22
  • May 16 - May 20
  • Norfolk, Virgina, US
  • Abstract submission until Nov 19
• September meeting schedule
  • Summer over, back to weekly meetings!
  • Sep 2
  • Sep 9 CERN holiday
  • Sep 16
  • Sep 23
  • Sep 30 Rucio workshop
• Rucio website Team introduction
  • For now I added/asked all component leads
  • All other developers are also very welcome to add their names/intro!
    • Please submit a PR to https://github.com/rucio/rucio.github.io
• Next week
  • GSOC student presentations
  • SIG-Metadata presentation from Belle II

15:05 → 15:15 Community News & DevOps roundtable

• ATLAS
  • Breakdown of one (out of 3) kube clusters
    • Master went down, all pods went down too
  • srm+https tests setup
  • Firewall
    • Puppet runs necessary to keep firewall exceptions, if they are managed by puppet
• CMS
  • Flux setup
    • Should be ready by September for 1.26
• Fermilab
  • 1.26 deployment for openshift
    • Working, but database update not yet done
  • Icarus experiment
  • Flask endpoint configuration
    • Now endpoint configuration templates available: api/auth/tracer/webui
• Belle II
  • Popularity activation
    • Tracer not well documented
• RAL/MultiVO
  • Moving to 1.26
• ESCAPE
  • Moving to 1.26 as well!
  • Building up testing suite for tokens

15:15 → 15:25 Hot topics

15:25 → 15:40 Datalake as a Service (DaaS)

Speakers: Muhammad Aditya Hilmy, Riccardo Di Maria (CERN)

Data Lake as a Service - Rucio Dev Meeting.pdf

15:40 → 15:55 Developers roundtable

Rucio 1.27 "Batdonkey v. Superdonkey" priority followup

• In Progress
  • Auditor overhaul #3437 [Dimitrios]
    • Will discuss with Dimitrios once he is back
  • rucio.cfg vs config table #2630 [Mario, David]
    • Needs review
  • Logging review #4220 [Martin, All comp leads]
    • No news
  • Disentangle fts3 specific code from conveyor and move to transfertool #857 [Radu]
    • Work ongoing
    • One open PR for submitter-stager merge
    • One other PR already prepared, will submit once previous merged
  • helm-charts release management #4794 [Radu, Eric, Martin]
    • Eric submitted comments to the issue
    • Switch to the new naming scheme first, thus next release would be 1.26.0
    • Needs to be described on the documentation
    • Github action needs to be upgraded to look into separate release branches
      • Probably not a big change
  • Quality of Service #3419 [Matt]
    • Demonstrator for sotrage-issued QoS changes for BNL MAS
    • Matt should have dev changes done in the coming weeks
• Todo
  • Get SSO Login working [Rizart]
  • Down-scoped tokens for user interactions #4791 []
  • Optimize database interactions #4793 [Martin, Mario, Radu]
  • Prepare replacement of current policy import with policy packages #4798 [James, Martin]
  • Rename Daemons to commonly understandable names #4795 [Martin]
  • Versioning for REST API #4796 [Ben, Martin]
  • Enabling tests for different policy package #3878 [Mayank]
• Done
• Delayed

Developer roundtable

• Docker auto builds
  • Docker still not allowing us to use the auto-build feature
  • No answers on support mails
  • Probably wait another week, but then implement auto-builds via github actions
• Enabling http on xrood containers
  • Almost there, needs a few more days, then comes as PR
• Change all daemon/server container images to use OIC 19.12 instead of OIC 21
  • Possibly some incompatibility issues with OIC 21
• Changing CI oracle-express database from 11 to 18
  • Still ongoing, should be there soon

15:55 → 16:00 AOB