Rucio Meeting

Thursday 17 Mar 2022, 15:00 → 16:00 Europe/Zurich

4/S-030 (CERN)

Martin Barisits (CERN)

15:00 → 15:05 News

• 1.28 code freeze
  • RC1 tomorrow
• WebUI Survey
  • Survey on google forms
    • Latest release of webui shows a banner with the link to the form
    • Most commonly used features
    • Improvements people would like to see
    • --> Priorities and plans
• Next meetings
  • March 24
    • 1.28 release retrospective
    • No meeting room! Meeting fully remote
  • March 31
    • 1.29 release planning
    • Component leads (and everyone else) please prepare your plans!

15:05 → 15:20 Community News & DevOps roundtable

• ATLAS
  • Tape challenge is a challenge
• CMS
  • Problem with list dataset replicas with normal vs --deep
    • Probably some code path where a collection replica is not created
• Fermilab DUNE/Icarus/...
  • Policy package for DUNE
  • RUBIN
    • Trying to bring rucio cluster online
    • Trying to identify storage
• Belle II
• Edinburgh DUNE
  • Removing S3 libraries (Boto, Boto3, etc.)
    • Is anyone using protocols/s3.py or s3boto.py? -> Please contact James
      • Goal would be to remove these
• ESCAPE
  • 1.26.9 -> 1.26.11 upgrade
  • Want to move to 1.27 but migration needs to be planned
• RAL MultiVO
  • Still blocked by token auth in test env

15:20 → 15:25 Hot topics

15:25 → 15:55 Developers roundtable

Progress-2022-03-17.png

• Rucio 1.28 "Teenage Mutant Ninja Donkeys" release roadmap followup
  • IN PROGRESS
    •  
  • IN REVIEW
    • Hermes 2 evolution #4610 [Cedric]
      • First PR is there, missing documentation
      • Dev container is missing Influx, Elastic, etc. would be needed for TESTING
        • Modify dev container
        • Might need some help on container modification
      • Option: Merge the PR now, and do a second one for integration testing with influx, elastic
    • Add MongoDB metadata plugin #5143 [Rob]
      • Waiting on the mongodb dependency PR
        • This needs to be merged first, for #5143 to go forward
      • Waiting on review - but should be all done 
        • Relies on a second PR for testing (mongodb dependency)
  • TODO
    • Clean dead code in the probes (ATLAS and common) #p/83 [Dimitrios, Eric]
      • PR this evening
      • Some of the probes are duplicated in the atlas puppet manifest -> needs to be double checked
    • Create a contributor guide for probes #p/84 [Dimitrios]
      • Should still be done by end of next week
  • DONE
    • BB8 rewrite #4706 [Cedric]
    • Create a prototype workflow with temporary tables #5130 [Radu]
    • Support prometheus metrics in daemons and servers #3416 [Radu]
    • Stabilize geoip based replica selection #5133 [Radu]
      • For refresh of the geoip database the creation time is now used
    • Reduce transfer tickets [Radu]
    • Disentangle fts3 specific code from conveyor poller and receiver #4873 [Radu]
    • Write documentation page about helm-charts and versioning #h/84 [Eric]
    • Fix broken Client and Rest API docs view #4992 [Joel]
      • REST API online on rucio.cern.ch/documentation
      • 60% of the endpoints are already there
    • Host python 2.7 deprecation meeting [Martin]
    • Host token evolution meeting [Martin]
    • Test framework for VO Specific tests #4797 [Mayank]
    • WebUI 2.0 Architecture preparation #5134 [Mayank]
    • Include new operator engine also to json based columns #5144 [Rob]
    • Create CMS-style consistency checking daemon #5113 [Stefan]
    • Clarify, implement and document a way how to include policy packages in containers/kubernetes #5138 [James]
  • DELAYED
    • Add symlinks for the new daemon names #5131 [Joel]
    • Prepare a clear list of changes which need to be made to use new daemon names #5132 [Joel]
    • Reduce rule tickets [Martin]
    • Document and cleanup discrepancies between surl and lfn2pfn algorithms #5129 [Martin]
    • Authentication workflows in WebUI 2.0 #5135 [Mayank]
    • Remove direct DB dependence from the WebUI #4319 [Mayank]
    • Test SSO Login to WebUI [Rizart]
      • Need some help in the UI
        • Initial IAM button just doesn't work
        • Needs some work in webui (probably)
•  

15:55 → 16:00 AOB