RAL Tier1 Experiments Liaison Meeting

Wednesday 18 Jun 2025, 13:30 → 15:50 Europe/London

Access Grid (RAL R89)

13:30 Experiment Operational Issues

1 ATLAS Operations Report

Speakers: Brij Kishor Jashal (Rutherford appelton laboratory), Jyoti Prakash Biswal (Rutherford Appleton Laboratory)

ATLAS liason meeting notes Brij

2 CMS Operations Report

Speaker: Katy Ellis (Science and Technology Facilities Council STFC (GB))

Katy may or may not make the meeting as she is in CMS Computing Management 3-day meeting.

Red day for SAM on Monday due to another network issue lasting a few hours. 

Otherwise a very good week for CMS at T1 - many running cores at end of last week and since the Monday network issues; highest CPU efficiency among all T1s. 

A few residual failures on Echo->Antares link since Monday network issues to investigate - may still be cleaned up automatically in time. Otherwise performance of transfers looks good. Wrote over 700TB to tape this week. 

3 LHCb Operations Report

Speaker: Alexander Rogovskiy (Rutherford Appleton Laboratory)

Operational issues:

• Network outage on Monday (GGUS:683544)
  • Site-wide network outage, affected LHCb as well (obviously)
  • Fixed on Monday evening
  • Is the reason behind this known?
• New Echo storage node inaccessible from 201[89] gen WNs (GGUS:683524)
  • Caused local gateways to get stuck and consequently all downloads from ECHO fail
  • Fixed now, network setup was changed to allow WNs to talk to the SN.
• Redirector issues this morning
  • Wrong DNS alias?

 

CVMFS:

• (monitoring) issues with squid0[56] are still present 
  • The machines are correctly resolvable from RAL, but not outside RAL (e.g. lxplus)
    • Added to internal DNS, but not external one?
    • FAB-1101 is tracking the issue

4 ALICE Operations Report

Speaker: Alexander Rogovskiy (Rutherford Appleton Laboratory)

5 LSST Operations Report

Speakers: Mathew Sims, Timothy Noble (Science and Technology Facilities Council STFC (GB))

• RC2 now ingested and running jobs
  • some hiccups, but seems to be there now
  • still issues with Step 3 requesting not enough Memory, but that has not been fixed in the pipeline and requires alterations on a run basis - once done, runs as expected
• Network blips seem to have extended run time of jobs, but jobs still succeeding
• IngetstD v20 now deployed
• Nalin got workable demo deployments of IngestD  / LSST monitoring stack and will soon deploying that for LSST monitoring, and then be looking at more in-depth job monitoring

 

 

 

14:00 Tier-1 Projects

6 Anatares Upgrade

New EOS nodes
Repack Progress

Speakers: George Patargias, Thomas Byrne

7 XRootD Development

Speakers: Alexander Rogovskiy (Rutherford Appleton Laboratory), Jyothish Thomas (STFC)

streamed checksum validation sitting at 99.94% currently. Rolling out next week in logging mode, prepared CC for switching to storage mode after.

error 500 cause possibly found - DNS entry mismatch

8 Utilizing GPUs

Speakers: Jyoti Prakash Biswal (Rutherford Appleton Laboratory), Thomas Birkett

14:45 AOB

9 Summary of Operational Status and Issues

Speakers: Brian Davies (Lancaster University (GB)), Darren Moore

Weekly Report 18 June 2025.docx

Weekly Report 18 June 2025.pdf

10 Any other Business

Speakers: Brian Davies (Lancaster University (GB)), Darren Moore