RAL Tier1 Experiments Liaison Meeting

Wednesday 4 Nov 2020, 13:30 → 14:30 Europe/London

Access Grid (RAL R89)

13:38 → 13:39 Major Incidents Changes

13:39 → 13:40 Summary of Operational Status and Issues

Speakers: Brian Davies (Lancaster University (GB)), Darren Moore (Science and Technology Facilities Council STFC (GB))

RT1EL-20201104.docx

RT1EL-20201104.pdf

13:40 → 13:41 GGUS /RT Tickets

https://tinyurl.com/T1-GGUS-Open
https://tinyurl.com/T1-GGUS-Closed

13:41 → 13:42 Site Availability

https://lcgwww.gridpp.rl.ac.uk/utils/availchart/

https://cms-site-readiness.web.cern.ch/cms-site-readiness/SiteReadiness/HTML/SiteReadinessReport.html#T1_UK_RAL

http://hammercloud.cern.ch/hc/app/atlas/siteoverview/?site=RAL-LCG2&startTime=2020-01-29&endTime=2020-02-06&templateType=isGolden

13:42 → 13:43 Experiment Operational Issues

13:44 → 13:45 VO-Liaison ATLAS

Speaker: James William Walder (Science and Technology Facilities Council STFC (GB))

20201102_ipv46_update.pdf

- singularity and user NS setup at RAL: https://ggus.eu/index.php?mode=ticket_info&ticket_id=146651 
  - Have been somewhat passive solar; complex upgrade, but after the EOL for SL6, would hope for some progress. 

- xrootd on lcg2432.gridpp.rl.ac.uk; 
 https://helpdesk.gridpp.rl.ac.uk/Ticket/Display.html?id=370403  
 xrootd fell over 'again' yesterday (on that node)

Oxford to start Storageless site tests with 128 cores and XCache;
RAL will act as endpoint Storage: https://its.cern.ch/jira/browse/ADCINFR-185 

SHEF started running jobs since weekend; main issues with IO intensive workloads and File transfer errors.
RAL is the Storage Endpoint; 
Can we (already) monitor these Storageless endpoints ?
Do we make any (performance-like) commitments to supporting these endpoints?

TPC-http
 - 'first' (?) proper sucessful demonstration of FTS transfer, with RAL as dest in pull configuration (using macaroons) 

 

 

 

 

 

13:46 → 13:47 VO Liaison CMS

Speaker: Katy Ellis (Science and Technology Facilities Council STFC (GB))

I'm looking at a long list of transfer errors from Rucio to RAL. They are recognisable errors - same as those seen with Phedex. Tape and disk.

IPv4 problems continue to be investigated.

Hammercloud tests failed for a while, leading us to go into drain briefly on Monday. This followed a drop-off in pending jobs in CMS worldwide.

Two different SRM endpoint problems were fixed by restarting various services.

I am working on migrating my AAA Vande page. The data source we were using has disappeared.

There are more failures than I would like on the AAA SAM tests. On an unrelated note, George P did an update yesterday to the ceph plugin. Might be worth a restart of all services today.

I hear the EGI accounting is up to date. I will re-do the 'other VO' quarterly report to correct the figures.

13:48 → 13:49 VO Liaison LHCb

Speaker: Raja Nandakumar (Science and Technology Facilities Council STFC (GB))

LHCb

1. Streaming from ECHO :
   • Ongoing development (?) from Ian Johnson
   • Waiting for fix to CEs / test system (jobs going to the whole of the farm). This is to test changes to the streaming block size.
2. Some issues writing to castor - probably due to the CRL issue over the weekend. Probably gone away
3. Problem with users listing files on ECHO fixed.

DUNE

Nothing special to report operationally. Some fixes to jobsub defaults to hopefully send user jobs to grid rather than just Fermilab.

13:52 → 13:53 VO Liaison Others

13:53 → 13:54 Experiment Planning

13:54 → 13:55 Dune/protoDune

13:55 → 13:56 Euclid

13:56 → 13:57 SKA

13:57 → 13:58 AOB

13:58 → 13:59 Any other Business

Speakers: Brian Davies (Lancaster University (GB)), Darren Moore (Science and Technology Facilities Council STFC (GB))