Nov 4 – 8, 2019
Adelaide Convention Centre
Australia/Adelaide timezone

Improvements in utilisation of the Czech national HPC center by ATLAS distributed computing

Nov 7, 2019, 11:15 AM
15m
Riverbank R1 (Adelaide Convention Centre)

Riverbank R1

Adelaide Convention Centre

Oral Track 9 – Exascale Science Track 9 – Exascale Science

Speaker

Michal Svatos (Acad. of Sciences of the Czech Rep. (CZ))

Description

ATLAS distributed computing is allowed to opportunistically use resources of the Czech national HPC center IT4Innovations in Ostrava. The jobs are submitted via an ARC Compute Element (ARC-CE) installed at the grid site in Prague. Scripts and input files are shared between the ARC-CE and the shared file system located at the HPC, via sshfs. This basic submission system has worked there since the end of 2017.
Several improvements were made to increase the amount of resources that ATLAS can use. The most significant improvement was the migration of the submission system to enable pre-emptable jobs, as the HPC center management made the decision to use pre-emption on opportunistic jobs. Another improvement of the submission system is related to the sshfs connection, which seemed to be a limiting factor of the system. Now, the submission system consists of several ARC-CE machines. Also, various parameters of sshfs were tested in an attempt to increase throughput. As a result of the improvements, the utilisation of the Czech national HPC center by the ATLAS distributed computing increased.

Consider for promotion No

Primary authors

Michal Svatos (Acad. of Sciences of the Czech Rep. (CZ)) Jiri Chudoba (Acad. of Sciences of the Czech Rep. (CZ)) Petr Vokac (Czech Technical University)

Presentation materials