Rucio Meeting

Thursday 13 Oct 2022, 15:00 → 16:00 Europe/Zurich

Mario Lassnig (CERN)

15:00 → 15:05 News

15:05 → 15:20 Community News & DevOps roundtable

• ATLAS
  • Activity "Data rebalancing" -> "Data Rebalancing"
    • CMS using it for manual submissions
    • Check with MONIT
  • ActiveMQ nodes / new IP addresses
    • suggest to implement Heartbeats
• CMS
  • Certs and CRLs from CVMFS rather than container supplied
    • "Public" inside CERN
  • Seems to work fine
  • Make CA certs optional (not to mount anymore)
  • To be shared in the near future
• Fermilab/RUBIN
  • Setting up Prometheus (also for DUNE dev server)
  • Radu
    • Use data directly from Grafana instance
    • Manual checks
  • New virtual k8s cluster at SLAC for Rubin 
    • Secrets  from vault
• ESCAPE/EOSC
  • Domenic (new student), Enrique (new fellow)
  • will install a new Rucio cluster
  • SSLv3 errors / Protocol not correct ?
    • HTTPS vs HTTP
• DUNE
  • Any consideration to Rucio issue (#5899) "Add distances between Non-Rucio sites (ie compute only sites) and RSE's" https://github.com/rucio/rucio/issues/5899
• SKAO
  • No news
• MultiVO/RAL
  • No news
• Belle II
  • Migrating to JSON metadata
  • Large scale tests - DB is getting big
  • Clean archive table is necessary
  • Archive table in different tablespace / database ?
    • Proxy / re-route..

15:20 → 15:25 Hot topics

15:25 → 15:55 Developers roundtable

• Rucio 1.30 "The Donkeynator" progress tracking
  • In Progress​​
    • Create a contributor guide for probes #84 [Dimitrios]
    • Adherence to rule grouping dependent on order of ATTACH #5251 [Igor]
    • Exchange `Tombstone` function-based indices with normal indices #5440 [Mario, Martin, Radu]
    • Create a server/daemon installation howto #5445 [Joel, Mayank]
      • To check with Joel
    • Add python 3.10 tests to CI framework. #5145 [Mayank]
      • Need to add another stage for mod_wsgi
    • Unable to Delete File DID via Undertaker #5154 [Martin]
      • More complicated than initially thought; still under investigation
    • Rules on containers in state OK but not all the files from the containers have locks #5447 [Martin]
    • Release webUI 2.0 beta version [Mayank]
      • request_new_rule page 
        • complete
      • testing framework introduced
        • Testing needed due to PRs breaking each other
    • rework conveyor-throttler #5805 [Radu]
    • Switch to pytest [Radu?]
  • In Review
    • UI Methods to declare replicas missing #5392
    • Introduce heartbeat handler to all daemons #5443 [Cedric]
  • Done
    • Further ingetragtion of CMS-style consistency checking #5438 [Igor]
    • Remove old readthedocs documentation once the new one is fully operational #5446 [Joel, Martin]
  • Todo
    • Create developers testing guide in the documentation #5452 [Joel, Mayank]
    • foreign key error on deleting dids in reaper #5733 [Martin]
    • Re-work/cleanup distance table #5454 [Radu]
    • Merge list_dids and list_dids_extended methods #5448 [Rob]
  • Delayed
    • Refactor the different test workflows to a common one [Ben, Mayank]
    • Add symlinks for the new daemon names #5131 [Joel]
    • Prepare a clear list of changes which need to be made to use new daemon names #5132 [Joel]
    • Document and cleanup discrepancies between surl and lfn2pfn algorithms #5129 [Martin]
    • Reduce rule tickets to les than 20 [Martin]
    • Reduce logging of server & daemons #5449 [Mayank
    • rework prometheus/statsd metric names #5804 [Radu]
    • Create documentation page for S3-type storage #5450 [Rizart]
      • Exists as GGDoc (#5284)
    • Add support for S3 virtual hosted buckets #5451 [Rizart]
      • Test on-premise
      • Ongoing support issue with AWS/Fresno X.509 shenanigans
• Other topics
  •  

15:55 → 16:00 AOB