Dealing with an issue right now....

GPFS getting overloaded => Hammercloud bounced us a couple of times yesterday.   Currently ~30% ddm failures.  Having to reboot one of our gridftp endpoints.   Possibly DAOD physics validation jobs?

xrd 5.2.0 with clustering and custom containers is working for the GPFS storage.

Preparing to buy worker nodes.