RAL Tier1 Experiments Liaison Meeting

Wednesday 8 Jul 2026, 13:30 → 15:50 Europe/London

Access Grid (RAL R89)

13:30 → 13:34 Site Operations

13:34 → 13:35 Experiment Operational Issues

13:35 → 13:40 ATLAS Operations Report

Speakers: Brij Kishor Jashal (Rutherford Appleton Laboratory), Jyoti Prakash Biswal (Rutherford Appleton Laboratory)

Brij ATLAS liason meeting notes

13:40 → 13:45 CMS Operations Report

Speaker: Katy Ellis (Science and Technology Facilities Council STFC (GB))

Katy sends apologies; she is at CMS-UK at Imperial yesterday and today.

Jobs and transfers running smoothly as usual. 

SAM test errors for webdav endpoint on Tuesday due to appearance of incorrect XRootD version which cannot handle macaroons. Appears not to affect CMS production. Was fixed in a couple of hours. 

Concerning the new VMs for AAA manager and national redirector: new machines are in production and old machines out of production. SAM tests are assigned appropriately. There was some confusion over this, hence the ggus tickets (both now closed). 

Jyothish added one XCache machine (svc42) as AAA proxy to production and seems to be working so far. Need to add it to the AAA Vande dashboard.

Issues seen with new accounting portal CPU efficiency calculation are fixed. Further checks required. 

Still to deal with /unmerged/

 

13:45 → 13:50 LHCb Operations Report

Speaker: Alexander Rogovskiy (Rutherford Appleton Laboratory)

jobs.png

transfers_from.png

transfers_to.png

Operational issues:

• Local WN proxy problems during the weekend [GGUS:1003268]
  • WN proxies forgot how to authenticates users. Restarts (mostly done by automation) fixed the problem. Ticket closed
• External echo gateways cannot generate macaroons [GGUS:1003285]
  • accidental upgrade to a buggy xrootd 5.9.3 version.
    • Rolled-back, ticket closed
• Checksum request redirection from WNs to external gateways
  • Fix is being tested on lcg2389, looks OK so far
• DIRAC release deployed this morning
  • Caused a temporary service outage
  • Hopefully fixes the issue with MCSimulation job failures due to incorrect CPUtime estimation
• ceph-svc40 overloaded on Tuesday
  • Caused transfer issues.

13:50 → 13:55 ALICE Operations Report

Speaker: Alexander Rogovskiy (Rutherford Appleton Laboratory)

Any news on GSTSM-756?

13:55 → 14:00 LSST Operations Report

Speakers: Thomas Birkett, Timothy Noble (Science and Technology Facilities Council STFC (GB))

• Few jobs run at RAL in last week - small number of high core count jobs currently running
  
• Data movement to RAL at 1TB at the start of the week
  
• Data movement from RAL to LANCS -  completed 1.2 million files (4TB) in around 24 hours
• 
• Toppping out at 1Gb a second and 200 files per second:
  

14:00 → 14:01 Tier-1 Projects

14:05 → 14:10 XRootD Development

Speakers: Alexander Rogovskiy (Rutherford Appleton Laboratory), Jyothish Thomas (STFC)

CMS AAA XCache has been added to prod, everything appears to be working fine
XrootD 5.9.3+ had a bug with macaroons, which was accidentally rolled out on the managers. This was quickly rolled back.
XRootD 6.1.0 is running fine 
odd failure on svc40 - looks like a NIC disconnection. No further details yet.
New script to group XRootD log errors by categories

14:15 → 14:20 Utilizing GPUs

Speakers: Dr Brij Kishor Jashal (Rutherford Appleton Laboratory), Thomas Birkett

14:25 → 14:45 Hardware deployment

Echo SN
WN
GPU

Speaker: Jacob Ward

14:45 → 14:46 AOB

14:50 → 14:59 Summary of Operational Status and Issues

Speakers: Brian Davies (Science and Technology Facilities Council STFC (GB)), Darren Moore, Thomas Birkett

Weekly Report 08 July 2026.docx

Weekly Report 08 July 2026.pdf

15:00 → 15:05 Any other Business

Speakers: Brian Davies (Science and Technology Facilities Council STFC (GB)), Darren Moore