Our new 550 TB is on-line and in space tokens.
Last weekend we had a GPFS/SRM problem appearing on Saturday, fixed on Sunday morning. This was related to the new 550 TB.
Unusually large numbers of "No such file or directory" errors for deletion only appeared and was ticketed. Nothing was wrong on our side. Resolved by:
"Issue resolved - from Cedric:
The problem is that the Dark Reaper was using the lcg-utils implementation for the deletion (which is slightly
broken) instead of the gfal one. I switched back to gfal and it's working now.
ggus 120723 was closed."
Smooth operations otherwise.
NESE proposal submitted to NSF (with Harvard, MIT, Northeastern, UMASS) :)
I just added 100TB free space from LOCALGROUPDISK(not in pledge) to DATADISK.
We are set up to add an additional 570 TB relatively inexpensively (two additional 60 drive MD3060e) if need be.