Rucio Development Meeting

Thursday 20 Aug 2020, 15:00 → 16:00 Europe/Zurich

Martin Barisits (CERN)

Zoom: https://cern.zoom.us/j/413496641

Meeting ID: 413 496 641
Find your local number: https://cern.zoom.us/u/aT2QQfXAo

15:00 → 15:10 News

• Meeting schedule September
  • September 3
    • FTS3 Check On Tape presentation
    • Native Desktop Application for Rucio presentation
  • September 10
    • CANCELLED (CERN Holliday)
  • September 17
    • Integration of Rucio in JupyterLab for SWAN
  • September 24
    • Support for Rucio Users with Native Language Processing
• Release schedule
  • 1.23.4 just released
  • 1.23.5 August 31
  • 1.23.6 September 14
  • 1.23.7 September 28
  • 1.24.0 "Auqadonkey" November
• Google Season of Docs
  • Divya Mohan joins us for this year Google Season of Docs to work on Rucio documentation
• Dockerhub Terms of Services change
  • "If an image has not either been pulled or pushed in the amount of time specified in your subscription plan, the image will be tagged “inactive.” Any images that are tagged as “inactive” will be scheduled for deletion."
  • Free plans will have a 6 month image retention limit
  • 100 pulls per 6 hours limit
  • We added Rucio to the CERN container registry https://gitlab.cern.ch/rucio/containers/container_registry
    • Mirror of Dockerhub

15:10 → 15:20 News from the experiments

• ATLAS
  • Getting HTTP TPC up & running
  • Cloud storage tests (Google)
• CMS
• RAL/UK
  • 1.23.4 running on the RAL instance!
  • Multi-VO Instance
    • DB migrated to Multi-VO - all tables migrated, skipped historic tables
    • SKA Functional tests running against the MVO instance
    • Authentication with X509 proxies not working at the moment
• Fermilab

15:20 → 15:30 Hot topics

• Copyright notice
  • Currently
    • # Copyright 2018-2020 CERN for the benefit of the ATLAS collaboration.
      #
      # Licensed under the Apache License, Version 2.0 (the "License");
      # you may not use this file except in compliance with the License.
      # You may obtain a copy of the License at
      #
      #    http://www.apache.org/licenses/LICENSE-2.0
      #
      # Unless required by applicable law or agreed to in writing, software
      # distributed under the License is distributed on an "AS IS" BASIS,
      # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
      # See the License for the specific language governing permissions and
      # limitations under the License.
      #
      # Authors:
  • "for the benefit of the ATLAS collaboration." to be removed since Rucio is a common software project
• Inclusive Code Language
  • Please pay attention to use inclusive code language when writing your contributions
  • In general our codebase is in a good state in that regard; Over the next weeks we will remove the last (few) mentions of terms like blacklist/whitelist in the codebase
• Drop of support for Python 2
  • As discussed at the last Rucio Community Workshop, we want to drop Python 2.7 support for the Rucio servers/daemons with the Rucio 1.24 (November) release
  • Any concerns?
    • Python 3 issue with webui package
      • To be investigated

15:30 → 15:55 Developers roundtable

• Recent client issues
  • Blocking issues are all fixed
  • Different problem found for add_replica registration
    • Multiple protocol priorities - failover immediately jumps from LAN to WAN, instead of trying the other priorities
• Rule submission
  • 1100 rules submitted
  • Requests injected
  • Requests failed with "Requests not in QUEUED state" ?
  • --> Ticket
• Kubernetes
  • Alarming integration with CERN-IT
  • PR Incoming for persistency (logs)

15:55 → 16:00 AOB