RAL Tier1 Experiments Liaison Meeting

Wednesday 3 Sept 2025, 13:30 → 15:50 Europe/London

Access Grid (RAL R89)

13:30 Experiment Operational Issues

1 ATLAS Operations Report

Speakers: Brij Kishor Jashal (Rutherford Appelton Laboratory), Jyoti Prakash Biswal (Rutherford Appleton Laboratory)

ATLAS liason meeting notes Brij

2 CMS Operations Report

Speaker: Katy Ellis (Science and Technology Facilities Council STFC (GB))

SAM tests: a blip today on CEs and AAA during the network intervention this morning. 

On Monday failures for Webdav on Echo due to Jyothish's changes to help regularise the naming of the site in Shoveler monitoring. He fixed it as soon as it was spotted. 

Great job performance this week. 

CMS are requesting an advance on next year's tape pledge. 

3 LHCb Operations Report

Speaker: Alexander Rogovskiy (Rutherford Appleton Laboratory)

Operational issues:

• LHCb job pressure was unstable throughout the week
  • Lack of MC productions, lack of jobs as a result
  • There is some improvement since yesterday
• Echo transfer issues last Monday
  • Problems with macaroon rejection after xrootd sitename change
  • Small impact on LHCb transfers, fixed within an hour since discovery
• IPv4 routing issues from LHCb ETF machines to 23 ECHO gateways (GGUS:1000451)
  • It is impossible to establish a connection to those gateways via IPv4 from `etf-0[56].cern.ch` machines
    • on connection establishment ACK packet does not reach the gateways
    • Seems to be routing issue, which is now tracked in JIRA (INFRA-483)
    • To mitigate the problem, affected gateways were removed from production
• A few spikes of failed WGProduction jobs last week
  • The usual issue -- buggy xrootd client

4 ALICE Operations Report

Speaker: Alexander Rogovskiy (Rutherford Appleton Laboratory)

5 LSST Operations Report

Speakers: Mathew Sims, Timothy Noble (Science and Technology Facilities Council STFC (GB))

• Data from all 4 Data Facilities has been processed, and returned according to the pipeline test for 2 datasets - verification is ongoing to ensure all sites produced the same results
• CCMS1 complete and verified at RAL
• New dataset to be sent to RAL soon - awaiting details
•  

14:00 Tier-1 Projects

6 Anatares Upgrade

New EOS nodes
Repack Progress

Speakers: George Patargias, Thomas Byrne

7 XRootD Development

Speakers: Alexander Rogovskiy (Rutherford Appleton Laboratory), Jyothish Thomas (STFC)

'23 gen out of prod again - OPN routing to etf hosts having issues
host certs for the '24 incoming
sitename reconfigured to RAL-LCG2
streamed checksum validation has made progress - mismatches now understood. 

8 Utilizing GPUs

Speakers: Jyoti Prakash Biswal (Rutherford Appleton Laboratory), Thomas Birkett

9 SSD Storage Evaluation

10 Echo deployment

15:00 AOB

11 Summary of Operational Status and Issues

Speakers: Brian Davies (Lancaster University (GB)), Darren Moore

Weekly Report 03 September 2025.docx

Weekly Report 03 September 2025.pdf

12 Any other Business

Speakers: Brian Davies (Lancaster University (GB)), Darren Moore