So far: 

Monday - planned to only half-fill the OPN but almost filled it (200Gbps).

Tuesday - cut of the OPN and fallback to the LHCONE. A slight drop observed but actually it worked pretty well. 

Wednesday - CMS injections crashed on tuesday evening at 8pm. All VOs restarted the injections this morning, drawing data from CERN and Tier 1s. Increased the rate to saturated the link and study T1->T1 links.

Even though FTS traffic dropped to 100Gbps, we still see nearly 200Gbps in the network plots. So we suspect streaming from CERN from CMS and LHCb...investigating. James A created new plots showing traffic to/from storage and WNs (but the WNs show internal data movements too).

CMS injections were interupted by actual production traffic. There were also DB issues which probably affected the submission of rules in Rucio. 

Deletions: CMS was behind in deletions before the mini-DC started (and had gone over pledge). So deletions were going to struggle during the mini-DC. Katy got additional Rucio reaper pods started up to focus purely on RAL. Although the rate-per-file of deletions is clearly slower than some other sites, RAL seemed able to keep up with the higher rate of deletions once it was being targeted with continuous deletion requests. 

To come:

Thursday - read tests from Echo 

Friday - probably cancelled/postponed (Tier 2 testing) due to major sites Lancaster and Manchester not being fully functional.