[smckee@umt3int03 ~]$ checkSRR.sh US Cloud: US Tier: 2 Site: AGLT2 Service: AGLT2_SE_0 RR URL: https://head01.aglt2.org/storage-descriptor.json gfal-copy url OK: /afs/atlas.umich.edu/home/smckee/checkSRRWorkdir/US/AGLT2_SE_0.json ---> storage service is missing latestupdate key in RR Json DDM endpoint: AGLT2_CALIBDISK TPC: WEBDAV:/atlascalibdisk/rucio/ TPC: SRMv2:/pnfs/aglt2.org/atlascalibdisk/rucio/ Used / total size: 208692783436190 / 215004751520739 = 97.06 % DDM endpoint: AGLT2_DATADISK TPC: WEBDAV:/atlasdatadisk/rucio/ TPC: SRMv2:/pnfs/aglt2.org/atlasdatadisk/rucio/ Used / total size: 7477442817007922 / 7823444720119238 = 95.58 % DDM endpoint: AGLT2_LOCALGROUPDISK TPC: WEBDAV:/atlaslocalgroupdisk/rucio/ TPC: SRMv2:/pnfs/aglt2.org/atlaslocalgroupdisk/rucio/ Used / total size: 143173983430880 / 250000000000000 = 57.27 % DDM endpoint: AGLT2_SCRATCHDISK TPC: WEBDAV:/atlasscratchdisk/rucio/ TPC: SRMv2:/pnfs/aglt2.org/atlasscratchdisk/rucio/ Used / total size: 126988092136497 / 170000000000000 = 74.70 % DDM endpoint: AGLT2_VP_DISK TPC: WEBDAV:/atlasvpdisk TPC: SRMv2:/pnfs/aglt2.org/atlasvpdisk ---> token ATLASVPDISK not found in RR Json Cloud: US Tier: 1 Site: BNL-ATLAS Service: BNL_OS_0 ---> RR URL: missing DDM endpoint: BNL-ATLAS_ES ---> no TPC for site DDM endpoint: BNL-ATLAS_LOGS ---> no TPC for site Service: BNL-ATLAS_SE_TAPETEST ---> RR URL: missing DDM endpoint: BNL-ATLAS_TAPE-TEST TPC: SRM-HTTPS:/pnfs/usatlas.bnl.gov/qostape Cloud: US Tier: 1 Site: BNL-ATLAS_VP Service: BNL-ATLAS_SE_0 RR URL: davs://dcgftp.usatlas.bnl.gov:443//pnfs/usatlas.bnl.gov/SRR/srr.json gfal-copy url OK: /afs/atlas.umich.edu/home/smckee/checkSRRWorkdir/US/BNL-ATLAS_SE_0.json Time downloaded: 1636566497 Json lastupdate: 1636566002 = 495 s ago DDM endpoint: BNL-ATLAS_VP_DISK TPC: WEBDAV:/pnfs/usatlas.bnl.gov/atlasvpdisk TPC: GRIDFTP:/pnfs/usatlas.bnl.gov/atlasvpdisk ---> token ATLASVPDISK not found in RR Json DDM endpoint: BNL-OSG2_DATADISK TPC: WEBDAV:/pnfs/usatlas.bnl.gov/BNLT0D1/rucio/ TPC: GRIDFTP:/pnfs/usatlas.bnl.gov/BNLT0D1/rucio/ Used / total size: 19006199964903928 / 19367797434825422 = 98.13 % DDM endpoint: BNL-OSG2_DET-SLHC TPC: WEBDAV:/pnfs/usatlas.bnl.gov/atlasgroupdisk/det-slhc/rucio/ TPC: GRIDFTP:/pnfs/usatlas.bnl.gov/atlasgroupdisk/det-slhc/rucio/ Used / total size: 189509428381331 / 450000000000000 = 42.11 % DDM endpoint: BNL-OSG2_LOCALGROUPDISK TPC: WEBDAV:/pnfs/usatlas.bnl.gov/LOCALGROUPDISK/rucio/ TPC: GRIDFTP:/pnfs/usatlas.bnl.gov/LOCALGROUPDISK/rucio/ Used / total size: 856919988801078 / 1345802232397824 = 63.67 % DDM endpoint: BNL-OSG2_PHYS-HI TPC: WEBDAV:/pnfs/usatlas.bnl.gov/atlasgroupdisk/phys-hi/rucio/ TPC: GRIDFTP:/pnfs/usatlas.bnl.gov/atlasgroupdisk/phys-hi/rucio/ Used / total size: 189509428381331 / 450000000000000 = 42.11 % DDM endpoint: BNL-OSG2_SCRATCHDISK TPC: WEBDAV:/pnfs/usatlas.bnl.gov/atlasscratchdisk/rucio/ TPC: GRIDFTP:/pnfs/usatlas.bnl.gov/atlasscratchdisk/rucio/ Used / total size: 520137175656888 / 934584883609600 = 55.65 % Cloud: US Tier: 1 Site: BNL-ATLAS Service: BNL-ATLAS_SE_TAPE URL: davs://dcgftp.usatlas.bnl.gov:443//pnfs/usatlas.bnl.gov/SRR/srr.json gfal-copy url OK; fetched already for BNL-ATLAS_SE_0 Time downloaded: 1636566497 Json lastupdate: 1636566002 = 495 s ago DDM endpoint: BNL-OSG2_DATATAPE TPC: SRMv2:/pnfs/usatlas.bnl.gov/BNLT1D0/ ---> TPC priority is SRMv2 Used / total size: 17683513974339 / 184689135452160 = 9.57 % DDM endpoint: BNL-OSG2_GROUPTAPE TPC: SRMv2:/pnfs/usatlas.bnl.gov/MCTAPE/atlasgrouptape/ ---> TPC priority is SRMv2 Used / total size: 18039154181064 / 118747255799832 = 15.19 % DDM endpoint: BNL-OSG2_MCTAPE TPC: SRMv2:/pnfs/usatlas.bnl.gov/MCTAPE/ ---> TPC priority is SRMv2 Used / total size: 18039154181064 / 118747255799832 = 15.19 % Cloud: US Tier: 3 Site: BNLHPC Service: BNLHPC RR URL: gsiftp://dcdoor01.usatlas.bnl.gov:2812/mnt/hpcdisk/space-usage.json gfal-copy url OK: /afs/atlas.umich.edu/home/smckee/checkSRRWorkdir/US/BNLHPC.json ---> missing storageservice in RR JSon DDM endpoint: BNLHPC_DATADISK TPC: GRIDFTP:/mnt/hpcdisk/atlasdatadisk/rucio TPC: GLOBUS:/mnt/hpcdisk/atlasdatadisk/rucio ---> TPC priority is GRIDFTP DDM endpoint: BNLHPC_SCRATCHDISK TPC: GRIDFTP:/mnt/hpcdisk/atlasscratchdisk/rucio/ TPC: GLOBUS:/mnt/hpcdisk/atlasscratchdisk/rucio/ ---> TPC priority is GRIDFTP Cloud: US Tier: 1 Site: BNLLAKE Service: BNLLAKE URL: davs://dcgftp.usatlas.bnl.gov:443//pnfs/usatlas.bnl.gov/SRR/srr.json gfal-copy url OK; fetched already for BNL-ATLAS_SE_0 Time downloaded: 1636566497 Json lastupdate: 1636566002 = 495 s ago DDM endpoint: BNLLAKE_DATADISK TPC: WEBDAV:/pnfs/usatlas.bnl.gov/lake/rucio TPC: GRIDFTP:/pnfs/usatlas.bnl.gov/lake/rucio TPC: SRM-HTTPS:/pnfs/usatlas.bnl.gov/lake/rucio Used / total size: 764090606259032 / 3200000000000000 = 23.88 % DDM endpoint: BNLLAKE_LOCALGROUPDISK TPC: WEBDAV:/pnfs/usatlas.bnl.gov/lake_localgroupdisk/rucio TPC: GRIDFTP:/pnfs/usatlas.bnl.gov/lake_localgroupdisk/rucio TPC: SRM-HTTPS:/pnfs/usatlas.bnl.gov/lake_localgroupdisk/rucio Used / total size: 4084775800 / 1300000000000000 = 0.00 % Cloud: US Tier: 3 Site: FRESNO-AWS Service: FRESNO-ATLAS-T3_OS_34 ---> RR URL: missing DDM endpoint: FRESNO-AWS_SCRATCHDISK TPC: AWS-HTTP: Cloud: US Tier: 3 Site: GOOGLE Service: GOOGLE_OS_EU ---> RR URL: missing DDM endpoint: GOOGLE_EU TPC: AWS-HTTP:/atlas-eu1 TPC: AWS-HTTP:/atlas-eu1 Cloud: US Tier: 2 Site: MWT2 Service: MWT2_SE_0 RR URL: gsiftp://uct2-gridftp.mwt2.org/pnfs/uchicago.edu/ddm/space-usage.json gfal-copy url OK: /afs/atlas.umich.edu/home/smckee/checkSRRWorkdir/US/MWT2_SE_0.json ---> missing storageservice in RR JSon DDM endpoint: MWT2_DATADISK TPC: WEBDAV:/atlasdatadisk/rucio/ TPC: GRIDFTP:/pnfs/uchicago.edu/atlasdatadisk/rucio/ DDM endpoint: MWT2_UC_LOCALGROUPDISK TPC: WEBDAV:/atlaslocalgroupdisk/rucio/ TPC: GRIDFTP:/pnfs/uchicago.edu/atlaslocalgroupdisk/rucio/ DDM endpoint: MWT2_UC_SCRATCHDISK TPC: WEBDAV:/atlasscratchdisk/rucio/ TPC: GRIDFTP:/pnfs/uchicago.edu/atlasscratchdisk/rucio/ DDM endpoint: MWT2_VP_DISK TPC: WEBDAV: TPC: GRIDFTP:/pnfs/uchicago.edu Service: MWT2_OS_0 ---> RR URL: missing DDM endpoint: MWT2_ES ---> no TPC for site DDM endpoint: MWT2_LOGS ---> no TPC for site Cloud: US Tier: 3 Site: NERSC-PDSF Service: NERSC-PDSFSRM_SE_0 RR URL: gsiftp://dtn01.nersc.gov:2811/global/cfs/cdirs/atlas/projecta/atlas/atlaslocalgroupdisk/dumps/space-usage.json gfal-copy error: 13 (Permission denied) - Could not stat the source: globus_ftp_client: the server responded with an error 530 530-Login incorrect. : globus_gss_assist: Gridmap lookup failure: Could not map /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=mckee/CN=500323/CN=Shawn Mc Kee 530- 530 End. ---> gfal-copy Failed: gsiftp://dtn01.nersc.gov:2811/global/cfs/cdirs/atlas/projecta/atlas/atlaslocalgroupdisk/dumps/space-usage.json DDM endpoint: NERSC_LOCALGROUPDISK TPC: GRIDFTP:/global/cfs/cdirs/atlas/projecta/atlas/atlaslocalgroupdisk/rucio/ ---> TPC priority is GRIDFTP Cloud: US Tier: 2 Site: BU_NESE Service: BU_ATLAS_Tier2_SE_173 RR URL: http://atlas.bu.edu/SpaceReporting/nese-srr.json gfal-copy url OK: /afs/atlas.umich.edu/home/smckee/checkSRRWorkdir/US/BU_ATLAS_Tier2_SE_173.json Time downloaded: 1636566501 Json lastupdate: 1636557733 = 8768 s ago ---> RR Json last updated more than 1 hour ago DDM endpoint: NESE_DATADISK TPC: WEBDAV:/atlas/datadisk/rucio Used / total size: 4106921722004303 / 4418381103104000 = 92.95 % DDM endpoint: NESE_SCRATCHDISK TPC: WEBDAV:/atlas/scratchdisk/rucio Used / total size: 14437495149897 / 50000000000000 = 28.87 % Cloud: US Tier: 2 Site: BU_ATLAS_Tier2 Service: BU_ATLAS_Tier2_SE_0 RR URL: http://atlas.bu.edu/SpaceReporting/gpfs-srr.json gfal-copy url OK: /afs/atlas.umich.edu/home/smckee/checkSRRWorkdir/US/BU_ATLAS_Tier2_SE_0.json Time downloaded: 1636566502 Json lastupdate: 1636557343 = 9159 s ago ---> RR Json last updated more than 1 hour ago DDM endpoint: NET2_DATADISK TPC: WEBDAV:/gpfs1/atlasdatadisk/rucio/ Used / total size: 3960497875383493 / 3990000000000000 = 99.26 % DDM endpoint: NET2_LOCALGROUPDISK TPC: WEBDAV:/gpfs1/atlaslocalgroupdisk/rucio/ Used / total size: 144354116195067 / 250000000000000 = 57.74 % DDM endpoint: NET2_SCRATCHDISK TPC: WEBDAV:/gpfs1/atlasscratchdisk/rucio/ Used / total size: 144354116195067 / 180000000000000 = 80.20 % DDM endpoint: NET2_VP_DISK TPC: WEBDAV:/atlasvpdisk/atlasvpdisk ---> token ATLASVPDISK not found in RR Json Cloud: US Tier: 3 Site: Nevis Service: Nevis_SE_0 RR URL: gsiftp://xenia.nevis.columbia.edu:2811//atlas/dq2/site-size.json gfal-copy error: 2 (No such file or directory) - Could not stat the source: globus_ftp_client: the server responded with an error 550 550-GlobusError: v=1 c=PATH_NOT_FOUND 550-GridFTP-Errno: 2 550-GridFTP-Reason: System error in stat 550-GridFTP-Error-String: No such file or directory 550 End. ---> gfal-copy Failed: gsiftp://xenia.nevis.columbia.edu:2811//atlas/dq2/site-size.json DDM endpoint: NEVIS_GRIDFTP TPC: GRIDFTP:/atlas/dq2/rucio/ ---> TPC priority is GRIDFTP Cloud: US Tier: 3 Site: OLCF Service: OLCF_SE_0 ---> RR URL: missing DDM endpoint: OLCF_DATADISK TPC: GLOBUS:/gpfs/alpine/csc343/world-shared/rucio/datadisk TPC: GRIDFTP:/gpfs/alpine/csc343/world-shared/rucio/datadisk DDM endpoint: OLCF_SCRATCHDISK TPC: GLOBUS:/gpfs/alpine/csc343/world-shared/rucio/scratchdisk TPC: GRIDFTP:/gpfs/alpine/csc343/world-shared/rucio/scratchdisk Cloud: US Tier: 2 Site: AGLT2 Service: AGLT2_OS_1 ---> RR URL: missing DDM endpoint: OSIRIS_ES ---> no TPC for site DDM endpoint: OSIRIS_LOG ---> no TPC for site Cloud: US Tier: 2 Site: OU_OSCER_ATLAS Service: OU_OSCER_ATLAS_SE_0 RR URL: root://se1.oscer.ou.edu:1094//xrd/atlasdatadisk/srr.json gfal-copy url OK: /afs/atlas.umich.edu/home/smckee/checkSRRWorkdir/US/OU_OSCER_ATLAS_SE_0.json Time downloaded: 1636566504 Json lastupdate: 1636565701 = 803 s ago DDM endpoint: OU_OSCER_ATLAS_DATADISK TPC: WEBDAV:/xrd/atlasdatadisk/rucio/ TPC: GRIDFTP:/xrd/atlasdatadisk/rucio/ Used / total size: 195440187861000 / 500000000000000 = 39.09 % DDM endpoint: OU_OSCER_ATLAS_LOCALGROUPDISK TPC: WEBDAV:/xrd/atlaslocalgroupdisk/rucio/ TPC: GRIDFTP:/xrd/atlaslocalgroupdisk/rucio/ Used / total size: 10903506792000 / 50000000000000 = 21.81 % DDM endpoint: OU_OSCER_ATLAS_SCRATCHDISK TPC: WEBDAV:/xrd/atlasscratchdisk/rucio/ TPC: GRIDFTP:/xrd/atlasscratchdisk/rucio/ Used / total size: 35304692988000 / 50000000000000 = 70.61 % Cloud: US Tier: 3 Site: SBU_Tier3 Service: SBU_Tier3_SE_0 ---> RR URL: missing DDM endpoint: SBU_TIER3_GRIDFTP TPC: GRIDFTP:/atlas/dq2/rucio/ ---> TPC priority is GRIDFTP Cloud: US Tier: 3 Site: WT2 Service: WT2_SE_183 RR URL: gsiftp://griddev01.slac.stanford.edu:2811/atlas/dq2/space-usage.json gfal-copy url OK: /afs/atlas.umich.edu/home/smckee/checkSRRWorkdir/US/WT2_SE_183.json ---> missing storageservice in RR JSon DDM endpoint: SLAC-ATLAS-T3_GRIDFTP TPC: GRIDFTP:/atlas/dq2/rucio/ TPC: GRIDFTP:/atlas/dq2/rucio/ ---> TPC priority is GRIDFTP Service: WT2_SE RR URL: https://osggridftp01.slac.stanford.edu:2094/xrootd/atlas/space-usage.json gfal-copy url OK: /afs/atlas.umich.edu/home/smckee/checkSRRWorkdir/US/WT2_SE.json Time downloaded: 1636566507 Json lastupdate: 1636566301 = 206 s ago DDM endpoint: SLACXRD_DATADISK TPC: WEBDAV:/xrootd/atlas/atlasdatadisk/rucio/ TPC: XROOTD://xrootd/atlas/atlasdatadisk/rucio/ TPC: GRIDFTP:/xrootd/atlas/atlasdatadisk/rucio/ Used / total size: 209668615460864 / 250000000000000 = 83.87 % DDM endpoint: SLACXRD_LOCALGROUPDISK TPC: WEBDAV:/xrootd/atlas/atlaslocalgroupdisk/rucio/ TPC: XROOTD://xrootd/atlas/atlaslocalgroupdisk/rucio/ TPC: GRIDFTP:/xrootd/atlas/atlaslocalgroupdisk/rucio/ Used / total size: 172186910144512 / 380000000000000 = 45.31 % DDM endpoint: SLACXRD_SCRATCHDISK TPC: WEBDAV:/xrootd/atlas/atlasscratchdisk/rucio/ TPC: XROOTD://xrootd/atlas/atlasscratchdisk/rucio/ TPC: GRIDFTP:/xrootd/atlas/atlasscratchdisk/rucio/ Used / total size: 295068264123392 / 350000000000000 = 84.31 % Cloud: US Tier: 3 Site: SMU_HPC Service: SMU_HPC_SE_0 RR URL: gsiftp://mfosgse.ehpc.smu.edu:2811/data/srm/atlaslocalgroupdisk/dumps/space-usage.json gfal-copy error: 110 (Connection timed out) - Could not stat the source: Operation timed out ---> gfal-copy Failed: gsiftp://mfosgse.ehpc.smu.edu:2811/data/srm/atlaslocalgroupdisk/dumps/space-usage.json DDM endpoint: SMU2_LOCALGROUPDISK TPC: GRIDFTP:/data/srm/atlaslocalgroupdisk/rucio/ ---> TPC priority is GRIDFTP Cloud: US Tier: 2 Site: SWT2_CPB Service: SWT2_CPB_SE_0 RR URL: davs://gk06.atlas-swt2.org:1094/xrd/datadisk/dumps/srr.json gfal-copy url OK: /afs/atlas.umich.edu/home/smckee/checkSRRWorkdir/US/SWT2_CPB_SE_0.json Time downloaded: 1636566568 Json lastupdate: 1636565701 = 867 s ago DDM endpoint: SWT2_CPB_DATADISK TPC: WEBDAV:/xrd/datadisk/rucio/ TPC: GRIDFTP:/xrd/datadisk/rucio/ Used / total size: 6014665803305984 / 6700000000000000 = 89.77 % DDM endpoint: SWT2_CPB_LOCALGROUPDISK TPC: WEBDAV:/xrd/atlaslocalgroupdisk/rucio/ TPC: GRIDFTP:/xrd/atlaslocalgroupdisk/rucio/ Used / total size: 168875902659584 / 400000000000000 = 42.22 % DDM endpoint: SWT2_CPB_SCRATCHDISK TPC: WEBDAV:/xrd/atlasscratchdisk/rucio/ TPC: GRIDFTP:/xrd/atlasscratchdisk/rucio/ Used / total size: 79737939950592 / 250000000000000 = 31.90 % DDM endpoint: SWT2_CPB_VP_DISK TPC: WEBDAV:/atlasvpdisk/atlasvpdisk TPC: GRIDFTP:/atlasvpdisk/atlasvpdisk ---> token ATLASVPDISK not found in RR Json