The dCache upgrade worked without a hitch; unfortunately, dCache itself did not.  We upgraded to version 2.10.51-1 from 2.10.42-1.  In the end, we rolled back to that 2.10.42-1 and the OOM conditions went away.  The problem was introduced at 2.10.49-1 in the 3rd party Netty library.  To quote Gerd Berdman, "The bug causes problems with throttling file loading when a slow HTTP client reads the file. Due to this the data gets queued in memory and for large files you will quickly run out of heap memory."  Netty was downgraded and dCache 2.10.52-1 has now been released.  However, we will not now do that upgrade, choosing instead to move to dCache 2.13 sometime towards the end of February.

All MSU R630 are now running jobs in Condor.  This is the last of the 2015 funds, and the v38 spreadsheet has been updated accordingly.

It is no longer needed (perhaps for some time now) to notify the OSG goc that a change in APEL Normalization factor has been made.  As long as the value in the resource is updated in OIM, it should propagate correctly within 24 hours into the WLCG reporting.  If it is NOT seen to update, then it should be reported.

The flapping NIC on msufs02 was fixed by re-seating the SFP+ cable at the EX4500 switch end.  However, some problems continue with the switch ports of this unit.  It will be updated to a newer software version sometime soon.

The new AGIS parameters minrss and maxrss were updated this morning, taking on reasonable values (we hope) for our site.

Over the next month we will prepare to update our site software, that will probably take place towards the end of February.  This may require a site down time of a day or two, but we are considering doing a rolling update over all WN.  Software to be updated includes OSG-CE, OSG-WN, cvmfs, HTCondor, and other small pieces as needed.