The dumps for BNL were provided by Hiro. DDMops jira opened: https://its.cern.ch/jira/browse/ATLDDMOPS-5465 . Consistency checks start running last week, found 1M dark files on the DATADISK and 120k files on the SCRATCHDISK. After deletions, looks like still significant leftover, which could be a reporting issue or not reported usage.

Dark Data situation (numbers with "-" mean storage reports less than size in rucio):

Site                  DATADISK                  SCRATCHDISK          LOCALGROUPDISK

BNL                 390                              110                              16

AGLT2             9                                  1                                  1

MWT2             9                                  8                                  2                                 

NET2               12                                5                                  0

OU_OSCER    -185                             -2                                 0

SWT2              3                                  1                                  0         

WT2                -81                               -5                                 1

IT monitoring team is still working to repopulate the missing data in DDM Accounting dashboard (the SNOW ticket I opened 2 weeks ago INC1705039). Right now the storage values for 8 recent days are still missing.

Hands-on session on the new DDM dashboard, with possibility to give feedback on issues with it we would like to be addressed, Friday. Nov.8 at 15:00 CET.