- updated ELK for log4j issues, applied other security updates.
- MSU received SLATE node, being installed with Alma Linux (per SLATE team request)
- MSU received network capture node, will also be Alma Linux (for Milan CPU)
- MSU received VMware storage node
- purchase plan: R740xd2 with 18T drives, R6525 with AMD 7452 (128 HT/node), final count to be determined after final quotes. Roughly $500k total and roughly 50/50 for storage/compute.
- Rebooting the cisco border switches caused ipv4 issues among various machines on the UM site, it caused cvmfs failure and squid servers failover. It took a couple of days to debug (between UM ITS and cisco support)to fix the issue.
- Another slate squid issue: does not show traffic on the CERN squid monitoring, had to rejoin the nodes to the k8s cluster to fix it.
- A patch was applied to the cisco border switches, which fixed the IPV6 forwarding (to Dell management switches) issues, so we were able to bring all the R620 work nodes whose data connections are through the Dell management switches back to condor.
- Merit Networks has had another issue on MiLR (our network that connects us to Chicago and East Lansing). This has broken our default route and access to and from AGLT2 from non research and education (R&E) networks.
- a typo in the routing rules change caused ipv6 ping failure to all CERN machines, a lot of jobs fail at rucio timeout. It was fixed the next morning.