RAL Tier1 Experiments Liaison Meeting

Wednesday 8 Nov 2023, 13:30 → 15:00 Europe/London

Access Grid (RAL R89)

14:00 → 14:01 Major Incidents Changes

14:01 → 14:02 Summary of Operational Status and Issues

Speakers: Brian Davies (Lancaster University (GB)), Darren Moore (Science and Technology Facilities Council STFC (GB)), Kieran Howlett (STFC RAL)

Weekly Report 01 November 2023.docx

Weekly Report 01 November 2023.pdf

Weekly Report 08 November 2023 (3)(1).docx

Weekly Report 08 November 2023 (3)(1).pdf

14:02 → 14:03 GGUS /RT Tickets

https://tinyurl.com/T1-GGUS-Open
https://tinyurl.com/T1-GGUS-Closed

14:04 → 14:05 Site Availability

https://lcgwww.gridpp.rl.ac.uk/utils/availchart/

https://cms-site-readiness.web.cern.ch/cms-site-readiness/SiteReadiness/HTML/SiteReadinessReport.html#T1_UK_RAL

http://hammercloud.cern.ch/hc/app/atlas/siteoverview/?site=RAL-LCG2&startTime=2020-01-29&endTime=2020-02-06&templateType=isGolden

14:05 → 14:06 Experiment Operational Issues

14:15 → 14:16 VO Liaison CMS

Speaker: Katy Ellis (Science and Technology Facilities Council STFC (GB))

14:16 → 14:17 VO-Liaison ATLAS

Speakers: James William Walder (Science and Technology Facilities Council STFC (GB)), Jyoti Prakash Biswal (Rutherford Appleton Laboratory)

FZKtoRAL_TransferEfficiency.png

RALtoFZK_TransferEfficiency.jpg

• RAL experienced HammerCloud exclusions earlier today, back online now:
  • http://bigpanda.cern.ch/job?pandaid=6014222140
  • pilot:::1152 File transfer timed out during stage-out: hc_test:output.1.99e8b66e-b113-432e-8423-701aa2694923_58654.pool.root to RAL-LCG2-ECHO_SCRATCHDISK, copy command timed out: TimeoutException: Timeout reached, timeout=311 seconds')]:failed to transfer files using copytools=['rucio'] .
  • Also, the number of failed jobs is >10% of the finished jobs!
  • Was this due to the gateways issue? YES!

 

•  FZK/RAL routing:
  • DDM plots attached.
  • Issue at FZK due to RAL change after the downtime? IPv6 new network -- LHCOPN related.
  • ATLAS FTS does only "pull" transfers from the source currently; the "push" is switched off (unlike CMS and LHCb).
  • Need to be discussed with the FZK-responsible over email -- GOCDB does not let one see the FZK emails, requires role!
  • James Adams could send the email?
  • A GGUS ticket is to be opened (by Brian).

 

• No SWAP issues noticed @RAL during the past 10 days or so.
  • Anything from Tom Birkett?

 

14:20 → 14:21 VO Liaison LHCb

Speaker: Alexander Rogovskiy (Rutherford Appleton Laboratory)

Operational issues:

1. A lot of failed uploads today, because of the ECHO issues.
2. Network issue between RALPP and RAL.
3. Problems with copying files from RRCKI to RAL
   • Low speed, most probably due to RRCKI issue.

14:25 → 14:28 VO Liaison LSST

Speaker: Timothy John Noble (Science and Technology Facilities Council STFC (GB))

14:30 → 14:31 VO Liaison Others

14:31 → 14:32 AOB

14:32 → 14:33 Any other Business

Speakers: Brian Davies (Lancaster University (GB)), Darren Moore (Science and Technology Facilities Council STFC (GB))