RAL Tier1 Experiments Liaison Meeting

Wednesday 3 Jan 2024, 13:30 → 15:00 Europe/London

Access Grid (RAL R89)

14:00 → 14:01 Major Incidents Changes

14:01 → 14:02 Summary of Operational Status and Issues

Speakers: Brian Davies (Lancaster University (GB)), Darren Moore (Science and Technology Facilities Council STFC (GB)), Kieran Howlett (STFC RAL)

Weekly Report 03 January 2024 (1).docx

Weekly Report 03 January 2024 (1).pdf

14:02 → 14:03 GGUS /RT Tickets

https://tinyurl.com/T1-GGUS-Open
https://tinyurl.com/T1-GGUS-Closed

14:04 → 14:05 Site Availability

https://lcgwww.gridpp.rl.ac.uk/utils/availchart/

https://cms-site-readiness.web.cern.ch/cms-site-readiness/SiteReadiness/HTML/SiteReadinessReport.html#T1_UK_RAL

http://hammercloud.cern.ch/hc/app/atlas/siteoverview/?site=RAL-LCG2&startTime=2020-01-29&endTime=2020-02-06&templateType=isGolden

14:05 → 14:06 Experiment Operational Issues

14:15 → 14:16 VO Liaison CMS

Speaker: Katy Ellis (Science and Technology Facilities Council STFC (GB))

A good holiday break for CMS with no particular new issues spotted. 

2nd Jan - Serious event with Echo, which went into unscheduled downtime for 24 hours. Katy put CMS in drain from the evening of the 2nd. At time of writing Echo is back and waiting for a complete set of green SAM tests before re-enabling CMS jobs.

The intermittent CVMFS test failures are still present on production CEs, ticket is here: https://stfc.atlassian.net/browse/GS-260. Failures are not appearing on the test CEs - the fix is a new kernel.

Consistency check is now appearing green for RAL disk - problem is fixed.

Ready to do pre-DC24 tests with Echo again. Can the overall rate be increased, and why did we see such a difference between CMS and ATLAS abilities to push data?

Tokens at RAL - some progress before Christmas, Jyothish has a couple of patches, more tests to come ASAP. Katy also helping test tokens for CMS in Rucio/FTS.

5.5 weeks until data challenge!

 

14:16 → 14:17 VO-Liaison ATLAS

Speakers: James William Walder (Science and Technology Facilities Council STFC (GB)), Jyoti Prakash Biswal (Rutherford Appleton Laboratory)

14:20 → 14:21 VO Liaison LHCb

Speaker: Alexander Rogovskiy (Rutherford Appleton Laboratory)

Smooth operations during the break.

Severe ECHO issues from 2nd to 3rd of January.

There was a consistency check during the break, some lost files were found. Most probably they are lost because of the problems with LHCb software.

Tickets:

• Slow checksums.
  • It seems to be possible to move checksum script run to checksum library. This removes the necessity to patch core xrootd.
  • It is also possible to calculate checksums in the library itself, without external script. Though this is more coplicated.
• Network issue between RALPP and RAL
  
  • No updates so far.

14:25 → 14:28 VO Liaison LSST

Speaker: Timothy John Noble (Science and Technology Facilities Council STFC (GB))

14:30 → 14:31 VO Liaison Others

14:31 → 14:32 AOB

14:32 → 14:33 Any other Business

Speakers: Brian Davies (Lancaster University (GB)), Darren Moore (Science and Technology Facilities Council STFC (GB))