Speaker
Description
We describe a set of tools developed to ease the execution of large computing campaigns over multiple and different computing resource providers. The tool suite has been adopted to perform the All-sky Continuous GW search on the data of the fourth LIGO-Virgo-KAGRA Observation cycle (O4), running CPU payloads on the IGWN Grid, INFN-CNAF, ICSC Grid (based on HTCondor , with different behaviors/capabilities) and GPU jobs on HPC resources (CINECA/Leonardo HPC, based on Slurm). Several features have been implemented to enable a uniform job submission pattern: input data retrieval from every possible source, checkpointing support where available, resilient output file delivery, automatic resubmission of failed jobs, support for all needed authentication/authorization methods such as X509, voms-proxy, scitokens and IAM tokens. Furthermore, a secure method to provide jobs with fresh credentials when needed has been implemented. An internal accounting system has also been put in place, which allows for custom metric collection; thanks to these data an accurate profiling of how efficiently the different computing resources are used is possible, which enables further configuration tuning. The tool proved to be robust, reliable, and general enough to perform unattended, with only minimal routine checks for maintenance. It has been adopted to run several other searches from within the Virgo Rome CW Group, by simply modifying a few configuration files. We outline a description of the main components of the tool, how these have been configured to run an All-sky search, how the different resource providers performed, and what possible improvements are foreseen.