• GPU HTCondor worker auto scaling is deployed at the Analysis Facility. Now HTCondor workers can better coexist with jupyter notebook servers to use the GPU resources.
• Hareware maintenence: we replaced fans and mother boards for half of the AF cluster to address faulty fan alerts issues. This was done in a rolling basis so there's no service outage. 
• A100 GPU node loaned to SSL for a HSF training event is now returned back to the Analysis Facility.

AF image change:

We have an image based on AnalysisBase 24.2.6 that we are using for the demo Physlite analysis.

It comes with dask integration and users can create personal K8s dask clusters that autoscales up to 100 cores. It took a long time to get dask dashboards to work correctly.

Since dask workers need the same libraries to run the analysis we had to give a lot of memory to dask workers... Later we will have to create dedicated much smaller images.

The simplest possible analysis on MC data works, but with real data there are issues with the PHYSLITESCHEMA eg. caloClusterLinks.

Will try to get this analysis working at scale before S&C.