GridPP Technical Meeting - SNO+ reprocessing campaign

Europe/London
Virtual Only

Virtual Only

Alastair Dewhurst (Science and Technology Facilities Council STFC (GB)), Andrew McNab (University of Manchester), David Colling (Imperial College (GB))
Description

Weekly meeting slot for technical topics. We will try and focus on one topic per meeting.  We will announce at the Tuesday Ops meeting if this meeting is going ahead and if so the topic to be discussed.

Zoom Meeting ID
95305495507
Host
Alastair Dewhurst
Alternative hosts
Brij Kishor Jashal, Samuel Cadellin Skipsey, Matthew Steven Doidge
Useful links
Join via phone
Zoom URL

A tracking detail of progress can be found here: https://helpdesk.ggus.eu/#ticket/zoom/3081

 

SNO+ want to run a reprocessing campaign in the next few months.  The input is ~200k raw files ~1GB average file size (200TB).  The output files are around 1.5GB each (300TB output products).  SNO+ may need to stage out data to other sites until end of calendar year.

 

While SNO+ is configured to use DIRAC the RAL settings are out of date (still shows Castor).  As well as setting up an Antares and Echo endpoint we will need to import a file list dump into DIRAC.  Given that DIRAC was unaware of files in Antares, it would imply that SNO+ is writing to Antares not via DIRAC. 

 

Actions:

George Patargias to create a dump of SNO+ files in Antares. - Done

George Patargias to find out which SNO+ users can access Antares / Voms.

Katy will contact Queen’s university to find out if this can be switched to DIRAC commands.

George P to contact Daniela and provide the necessary information for Antares configuration.

Rob A to contact Daniela and provide the necessary information for Antares configuration.

Daniela has asked for permission to temporarily join the SNO+ VO. 

 

We aim to demonstrate that we can functionally recall data from Antares to Echo and run jobs over it next week and then we can work on automating this over the few weeks around Easter.

There are minutes attached to this event. Show them.
    • 11:00 11:45
      DIRAC / Echo / Antares configuration changes needed for SNO+ reprocessing 45m
      Speakers: Alastair Dewhurst (Science and Technology Facilities Council STFC (GB)), Daniela Bauer (Imperial College (GB))
    • 11:45 12:00
      Discussion 15m
      Speaker: Alastair Dewhurst (Science and Technology Facilities Council STFC (GB))