Rucio Development Meeting

Europe/Zurich
Martin Barisits (CERN)
Videoconference
Rucio Development Meeting
Zoom Meeting ID
413496641
Host
Martin Barisits
Alternative hosts
Cedric Serfon, Mario Lassnig, Dimitrios Christidis
Passcode
28849311
Useful links
Join via phone
Zoom URL
    • 15:00 15:05
      News 5m
      • Rucio 1.26 progress
        • RC2 just released, testing going very well
        • Final in the next days
      • Rucio Special Interest Groups
        • Activity to bring together people with a special interest in a specific topic (involving) Rucio
        • Inform and learn from each others plans, tests, outcomes; plan developments;
        • Discussions/coordination via dedicated mailing lists / chats
          • Dedicated meetings only if needed, otherwise discussion within the Rucio Dev meeting
        • Current (just started) SIGs
          • Metadata
            • rucio-sig-metadata@cern.ch
            • Metadata evolution in Rucio, community usecases, benchmarks, etc.
          • QoS
            • rucio-sig-qos@cern.ch
            • Storage QoS in Rucio
            • We will start from prototyping a simple "storage-self managed QoS" usecase and evolve the system from there
        • Possible SIGs
          • DIRAC
            • Might be useful to coordinate the different efforts from Rucio for a DIRAC interface
            • Opinions?
          • ?
      • Rucio 1.27 "Batdonkey v Superdonkey" release planning in Dev meeting on Aug 12
    • 15:05 15:15
      Community News & DevOps roundtable 10m
      • ATLAS
        • Deployed 1.26
          • rse_id index on replicas
            • Caused big load on database due to non-optima query plans
            • Set the index to invisible
            • For anyone running oracle:
              • Monitor the deployment and look at query plans
            • Index is not used at the moment anyway
      • CMS
        • Some Transfers stay in QUEUED state forever
          • Possibly fixed with 1.26?
          • Lack of logging messages, very hard to understand what is happening
            • Radu: Planning to add more information
      • Fermilab
        • Delegation of proxies to FTS3
          • Extend cron to include credentials
        • Rubin Obervatory discussions on how to integrate Rucio in their data framework
      • Belle II
        • Upgrade to 1.26.1 when it is out
          • .1 because still waiting for some PRs to be merged
      • SKAO
        • Metadata
          • SKAO working on metadata PR
          • Evolving equality engine PR from Gabriele
        • Deployment
          • SSL Ingress issues
          • Keeping up with helm-charts and changes there
      • DUNE/Edinburgh
        • LFN2PFN algorithm for DUNE metadata catalog
          • One code change missing, should not be controversial (for 1.26.1?)
        • Light-weight client plan
          • Make client more flexible in terms of locally installed tools
            • GSOC student also working on this
      • ORNL
        • Looking into Rucio
      • ESCAPE
        • Fully configured OIDC rucio instance
          • Users already testing, works well
        • After summer commencing full-stack tests
        • Tests with transmogrifier
    • 15:15 15:25
      Hot topics 10m
    • 15:25 15:55
      Developers roundtable 30m
      • Big backlog of PR
        • Big backlog of PRs due to Code Freeze (Should be over on Monday)
        •  
      • Datasetlocks not getting properly deleted #1860
      • Issue with lost source
        • Possible due to race-condition when rules gets STUCK
          • sources are cleared out
          • Only new sources created when transfer is re-submitted, but might take time
          • In this time-window, the replica might be unprotected
          • Possible solutions:
            • Check if there is a REPLICATING replica, and not delete them
            • Keep requests (and sources)?
        • Ticket #
    • 15:55 16:00
      AOB 5m
      • Next week no meeting (Summer schedule)!