Rucio Meeting

Europe/Zurich
Martin Barisits (CERN)
Videoconference
Rucio Development Meeting
Zoom Meeting ID
413496641
Host
Martin Barisits
Alternative host
Mario Lassnig
Passcode
28849311
Useful links
Join via phone
Zoom URL
    • 3:00 PM 3:05 PM
      News 5m
      • Google Summer of Code 2022
        • If you are interested to do a Rucio project, please let me know
        • Deadline February 21
        • Two project durations: short (175h), long (350h)
      • February meeting schedule
        • Feb-03 Cancelled
        • Feb-10
        • Feb-17 Python 2.7 deprecation discussion
        • Feb-24
      • February release schedule
        • 1.27.4 Jan-31
        • 1.23.18 LTS Feb-07
        • 1.27.5 Feb-14
        • 1.26.11 LTS Feb-21
        • 1.27.6 Feb-28
    • 3:05 PM 3:20 PM
      Community News & DevOps roundtable 15m
      • ATLAS
        • Database performance improvements/issues
        • http 503 incidents
          • Coming from authentication servers
          • Still under investigation
        • Network throughput test with NOTED service
          • Karlsruhe <-> TRIUMF
      • CMS
        • cache-consumer almost working again
        • list_replicas on cache RSEs
          • Protocol needs to be setup
      • Fermilab/DUNE/Rubin/...
        • DUNE Rucio deployment now available offsite
      • Belle II
      • Edinburgh/DUNE
        • Continuing with Policy packages in Containers
      • RAL/MultiVO
        • S3 and IRIS IAM integration
      • ESCAPE
        • Database possibly in a strange state
          • RSE usage counters vs Stats from the site
          • Script to resync the counters
          • Difference in counters could mean dark-data or dataloss
      • SKAO
        • Started migrating to tokens 
          • with ESCAPE IAM
    • 3:20 PM 3:25 PM
      Hot topics 5m
    • 3:25 PM 3:55 PM
      Developers roundtable 30m
      • Rucio 1.28 "Teenage Mutant Ninja Donkeys" release roadmap followup
        • IN PROGRESS
          • Fix broken Client and Rest API docs view #4992 [Joel]
            • Decided on framework OpenAPI, now implementing the render
              • Will be a mixture between Py-Doc and FLASK (Flask plugin for OpenAPI)
          • Test framework for VO Specific tests #4797 [Mayank]
            • New test suite: vo-tests
            • Part left:
              • Adding configuration
              • Use composite workflows for repeated workflows (auto-test + vo-tests)
              • PR this week
          • Authentication workflows in WebUI 2.0 #5135 [Mayank]
          • WebUI 2.0 Architecture #5134 [Mayank]
          • Stabilize geoip based replica selection #5133 [Radu]
            • Issue found, test case done, PR almost finished
          • Host python 2.7 deprecation meeting [Martin]
          • Host token evolution meeting [Martin]
            • Will send out eMails this week
          • Clarify, implement and document a way how to include policy packages in containers/kubernetes #5138 [James]
            • Started experiments with policy containers
          • Include new operator engine also to json based columns #5144 [Rob]
          • Reduce transfer tickets [Radu]
            • 2 to be closed, 1 more to be opened
        • IN REVIEW
          • Hermes 2 evolution #4610 [Cedric]
            • First PR is there, missing documentation
            • Dev container is missing Influx, Elastic, etc. would be needed for TESTING
              • Modify dev container
          • BB8 rewrite #4706 [Cedric]
            • First draft already in December
            • Had discussion with CMS how they want to rebalance data
            • Query to select data is very ATLAS specific, now parameterizable
            • Would be good if CMS has a look on this too
          • Create CMS-style consistency checking daemon #5113 [Stefan]
            • PR is there, including comments from Eric
            • Update to PR probably today, no roadblocks
        • TODO
          • Reduce rule tickets [Martin]
          • Document and cleanup discrepancies between surl and lfn2pfn algorithms #5129 [Martin]
          • Disentangle fts3 specific code from conveyor poller and receiver #4873 [Radu]
          • Add symlinks for the new daemon names #5131 [Joel]
          • Prepare a clear list of changes which need to be made to use new daemon names #5132 [Joel]
          • Clean dead code in the probes (ATLAS and common) #p/83 [Dimitrios, Eric]
          • Create a contributor guide for probes #p/84 [Dimitrios]
          • Remove direct DB dependence from the WebUI #4319 [Mayank]
          • Add MongoDB metadata plugin #5143 [Rob]
        • DONE
          • Create a prototype workflow with temporary tables #5130 [Radu]
          • Support prometheus metrics in daemons and servers #3416 [Radu]
          • Write documentation page about helm-charts and versioning #h/84 [Eric]
      • Pull Request github action errors
        • Was an issue on master, fixed now
      • Research on UI features to prioritise
        • WebUI would be good to get in touch with some users to get usecases for the next webUI
    • 3:55 PM 4:00 PM
      AOB 5m