RAL Tier1 Experiments Liaison Meeting

Wednesday 13 Jan 2021, 13:30 → 14:30 Europe/London

Access Grid (RAL R89)

Please attend via the following Zoom meeting:

https://ukri.zoom.us/j/98562731547?pwd=UU9Wb2xCL05tWmROT1h6SUlWdUJ3dz09

13:38 → 13:39 Major Incidents Changes

13:39 → 13:40 Summary of Operational Status and Issues

Speakers: Brian Davies (Lancaster University (GB)), Darren Moore (Science and Technology Facilities Council STFC (GB))

RT1EL-20210120.docx

RT1EL-20210120.pdf

13:40 → 13:41 GGUS /RT Tickets

https://tinyurl.com/T1-GGUS-Open
https://tinyurl.com/T1-GGUS-Closed

13:41 → 13:42 Site Availability

https://lcgwww.gridpp.rl.ac.uk/utils/availchart/

https://cms-site-readiness.web.cern.ch/cms-site-readiness/SiteReadiness/HTML/SiteReadinessReport.html#T1_UK_RAL

http://hammercloud.cern.ch/hc/app/atlas/siteoverview/?site=RAL-LCG2&startTime=2020-01-29&endTime=2020-02-06&templateType=isGolden

13:42 → 13:43 Experiment Operational Issues

13:44 → 13:45 VO-Liaison ATLAS

Speakers: James William Walder (Science and Technology Facilities Council STFC (GB)), Dr Tim Adye (Science and Technology Facilities Council STFC (GB))

ATLAS Repack:
  Expect to complete by next week.

13:46 → 13:47 VO Liaison CMS

Speaker: Katy Ellis (Science and Technology Facilities Council STFC (GB))

Loadtests (small, functional tests) are now running for tape, which gets around the problem of no tape transfers coming to RAL (due to full tape usage). FTS status is now valid.

No response from Mike Jones on the network updates. Martin Bly said it was mentioned in the NUG meeting but didn't hear a suggested date for the next intervention, which should be enabling jumbo frames in the firewall.

I have been making enquiries about AAA monitoring. Apparently there are GDPR concerns in Europe which is slowing the progress here. Continuing to ask questions about this.

 

13:48 → 13:49 VO Liaison LHCb

Speaker: Raja Nandakumar (Science and Technology Facilities Council STFC (GB))

LHCb:

User jobs completely failing to open files on ECHO

• https://ggus.eu/?mode=ticket_info&ticket_id=149909
• Problem identified - many thanks to Tom Byrne for support
• Issue : Opening files with xrootd client version <= 4.9.X is problematic
• Solution : Move to xroot version >= 4.10.X
• JIRA ticket open within LHCb : https://its.cern.ch/jira/browse/LBCORE-1990
• Hopefully solution is imminent

ECHO streaming issue

• https://ggus.eu/?mode=ticket_info&ticket_id=142350
• Waiting for improvements / development to xroot-ceph plugin
• Testing out 32KB block sizes
  • Test job execution hit by two bugs
    • ARC publishing bug
    • RAL-PPD UI being down
  • Waiting for system to stabilise before drawing any major conclusions

 

DUNE:

Since stopping all DNs except the robot DNs, some evidence again that much fewer jobs coming into RAL.

• Not clear why.
• DUNE says that there are not many jobs in the pipeline
• Jobs do come in to RAL - just not as much as before (e.g. RAL-PPD). But not easy to compare either.
• DUNE says that all jobs should be coming in with the robot DN
• Plan : Wait for the fix to ARC CEs.
• But not clear how to follow up - maybe we need to take a look again at the pilot factory configuration.
• http://gfactory-2.opensciencegrid.org/factory/monitor/factoryEntryStatusNow.html

13:52 → 13:53 VO Liaison Others

13:53 → 13:54 Experiment Planning

13:54 → 13:55 Dune/protoDune

13:55 → 13:56 Euclid

13:56 → 13:57 SKA

13:57 → 13:58 AOB

13:58 → 13:59 Any other Business

Speakers: Brian Davies (Lancaster University (GB)), Darren Moore (Science and Technology Facilities Council STFC (GB))