RAL Tier1 Experiments Liaison Meeting

Wednesday 8 Mar 2023, 12:30 → 14:30 Europe/London

Access Grid (RAL R89)

13:00 → 13:01 Major Incidents Changes

13:01 → 13:02 Summary of Operational Status and Issues

Speakers: Brian Davies (Lancaster University (GB)), Darren Moore (Science and Technology Facilities Council STFC (GB))

Weekly Report 08 March 2023 .docx

Weekly Report 08 March 2023 .pdf

13:02 → 13:03 GGUS /RT Tickets

https://tinyurl.com/T1-GGUS-Open
https://tinyurl.com/T1-GGUS-Closed

13:04 → 13:05 Site Availability

https://lcgwww.gridpp.rl.ac.uk/utils/availchart/

https://cms-site-readiness.web.cern.ch/cms-site-readiness/SiteReadiness/HTML/SiteReadinessReport.html#T1_UK_RAL

http://hammercloud.cern.ch/hc/app/atlas/siteoverview/?site=RAL-LCG2&startTime=2020-01-29&endTime=2020-02-06&templateType=isGolden

13:05 → 13:06 Experiment Operational Issues

13:15 → 13:16 VO Liaison CMS

Speaker: Katy Ellis (Science and Technology Facilities Council STFC (GB))

Temperature spike in the machine room was quickly fixed and did not have a particular effect on CMS. 

New SAM tests started for CMS last week:

1. Token tests are not yet passing, and not expected to. 

2. The main issue was the 3_crtExtension test which is supposed to ls a directory, which clearly cannot happen on our object store. A file called /store was created to try to get around this, but we went through various scenarios with the authdb file trying to allow the test permissions to ls it, all failing until yesterday. The correct config has now been rolled out to the gateways and the test is passing as of today. We were going into drain (from Friday) because of this, but it was 'corrected' by CMS and we stopped going into drain from Saturday night. 

3. The first ever tests for Antares (xrootd) started, but are all failing as Antares is in DT for frame extension all of this week. 

4. Tests for the xrootd.echo.stfc.ac.uk endpoint have started (all passing except tokens).

5. For some reason the srm/castor tests are back and of course they all fail. Trying to get this endpoint removed entirely.

 

Job performance is quite up and down. Failures are no worse than elsewhere but efficiency is intermittently poor in the last few days - to be investigated. 

I have been chasing up improvements to FTS config at the various instances used by CMS, including RAL. CMS are not using RAL FTS right now, but if we do in the future we need the config to be optimal. Rose is working on this. 

13:16 → 13:17 VO-Liaison ATLAS

Speakers: James William Walder (Science and Technology Facilities Council STFC (GB)), Jyoti Prakash Biswal (Rutherford Appleton Laboratory)

13:20 → 13:21 VO Liaison LHCb

Speaker: Alexander Rogovskiy (Rutherford Appleton Laboratory)

6271c8f611643ab4c8a7735516d0b166.png

8529a22fa96cfa1dfaee0819a0a4574b.png

dd8b4c951cd1ebcacc6a5955f295cdc5.png

1. Vetor read.
   • Two WNs (lcg2269 and lcg2270) have the patch applied
   • Not a single failure due to vector read issues
   • I'd carefully say that it is starting to look promising.
2. Xrootd patch to support openssl 3
   • Patch was applied on the whole farm last week. It was not according to plan, due to my mistakes (sorry about that..)
   • Looks OK so far
3. ECHO outage due to AC Problmes last Thursday

13:25 → 13:28 VO Liaison LSST

Speaker: Timothy John Noble (Science and Technology Facilities Council STFC (GB))

13:30 → 13:31 VO Liaison Others

13:31 → 13:32 AOB

13:32 → 13:33 Any other Business

Speakers: Brian Davies (Lancaster University (GB)), Darren Moore (Science and Technology Facilities Council STFC (GB))