Raw data distribution starts very soon (planned for today or tomorrow)
- 1PB free on antares LHCb allocation (which is 2024-25 FY), so need update it soonish.
ECHO problems (faulty disk on the 30th of April causing some slow IOPs + slow IOPs for uknown reason on the 7th of May) caused file loss and corruption (GGUS 683184)
- Search for corrupted files is finished
  - A handful of files found, the ones that have other replicase have already been re-replicated to RAL
  - That (hopefully) concludes the incident
There were a lot of upload failures from HLTFarm and NIPNE to RAL
- Not our fault
  - Network issues at NIPNE and HLTFarm connectivity problems

CVMFS (sorry, misplaced):

There is a proposal to make RAL Stratum-1 an official mirror of the EESSI repository. Any thoughts on that?

squid0[56] machines were added to the cvmfs-squid alias. That caused some problems for ATLAS and CMS

PTR records were added to reverse DNS zone as well, e.g.

$ host 130.246.183.211
211.183.246.130.in-addr.arpa domain name pointer cvmfs-squid.gridpp.rl.ac.uk.
211.183.246.130.in-addr.arpa domain name pointer squid06.gridpp.rl.ac.uk.
211.183.246.130.in-addr.arpa domain name pointer cms-squid.gridpp.rl.ac.uk.
211.183.246.130.in-addr.arpa domain name pointer atlas-squid.gridpp.rl.ac.uk.

That's most probably the cause of the issues. As of this morning, the DNS change (full, e.g. for both Forward and Reverse zones) is rolled-back.