Some discussion about the current downtime
We were upgrading our routing to evolve our router infrastructure so that it can operate with SENSE. Part of this work is to segregate the several different routing services (LHCONE, non-LHCONE, FABRIC, SENSE, ...) in different virtual routers and, in the process, ensure that only LHCONE communication goes through the L3VPN. We thought these changes would be transparent but it turn out not to be the case. Non-LHCONE routing to NESE has stopped and this is preventing transfers to go through (and really begs the question why do we have to deal with requests outside of LHCONE). Jessa is working to fix it, but it will take another O(day) [estimate].
These improvements being pursued will also help us to reduce the asymmetric ASN paths that were flagged last week. On the other hand, this also means that several NET2_MCTAPE transfer requests will timeout, but that's expected.
We are working on preparing for the OKD upgrade. The first attempt was planned for this week, but we must postpone it now.
We are progressing on the understanding of the tape system from our experience with Fabio's tests.