- Compact style
- Indico style
- Indico style - inline minutes
- Indico style - numbered
- Indico style - numbered + minutes
- Indico Weeks View
WLCG related:
Facility related meetings
Facility milestones
OSG 3.4.41/3.5.7
Targeted for this week or next:
Anyone using the rolling release repository? https://opensciencegrid.org/docs/release/notes/
OSG 3.4.42/3.5.8
Targeted for Jan 2020
HTCondor-CE upgraded sitewide to 4.0.1-1
UC
IU
UIUC
SWT2_CPB:
An issue with a mount from an MD3XXX is being problematic, will try to recover today, or declare ~30TB lost.
Squids have been updated to latest version from OSG.
UTA_SWT2:
Campus network disruption isolated the cluster for half of yesterday
Squids have been updated to latest version from OSG.
OU:
OSCER maintenance today.
Other than that, no issues.
Testing new development pilot and new Singularity container at BNL KNL Cluster.
The Harvester instance (python v2) is currently running two test jobs. Will likely need
to fix the stage out.
Since Cori has come back from the 12/5-12/6 shutdown, NERSC has only run 6580 jobs. 2.942 M events. in the 6 days prior to that NERSC processed 12.25 M events (22K jobs)
We have used over 101 M NERSC hours out of an initial allocation of 122 M hours. Due to Jumbo Job running we have only been charged 88M hours and have 38M hours remaining.
We might not use all of our time by 10-Jan
Deploying Harvester at Stampede2, Frontera:
A lot of discussions on how to change Perfsonar data ingest to ease data analysis. Now changing indexing. Once that's done we will have to replay the raw data from the tape. It will take significant time as replay of one day takes few hours. All other platforms are working fine. Smaller issues with ES (dead disk). Soon we will add 4 more data nodes and upgrade ES to 7.5.
A lot of debugging of xcache issue where xcache server "forgets" its proxy and can't authenticate against origin servers. The issue does not appear related to network state, load on the node.
It was reproduced a lot of times, and Andy is looking at the very detailed logs. A lot of Analysis jobs are failing at MWT2 for this reason. Will forward mail thread to Wei.