16–20 Oct 2017
KEK
Asia/Tokyo timezone

Running HEP Payloads on Distributed Clouds

18 Oct 2017, 14:50
20m
KEK

KEK

1-1 Oho, Tsukuba, Ibaraki 305-0801 Japan 36°09'01.0"N 140°04'28.1"E 36.150290, 140.074485
Grid, Cloud & Virtualisation Clouds, virtualisation, grids

Speaker

Rolf Seuster (University of Victoria (CA))

Description

The University of Victoria HEP group has been successfully running on distributed clouds for several years using the CloudScheduler/HTCondor framework. The system uses clouds in North America and Europe including commercial clouds. Over the last years, the operation has been very reliably, we are regularly running several thousands of jobs concurrently for the ATLAS and Belle II experiments. Currently we are writing a new version of CloudScheduler (version 2) that aims at further increasing the scale of number of jobs to levels in excess of 10,000. Further, it will be easier to configure existing and new clouds, as well as automate more of the operation of the clouds. We describe our operation experience and review the planned changes to the system.

Desired length 15

Authors

Rolf Seuster (University of Victoria (CA)) Randy Sobie (University of Victoria (CA)) Frank Berghaus (University of Victoria (CA)) Marcus Ebert (University of Victoria) Michael Paterson (U) Colin Roy Leavett-Brown (University of Victoria (CA)) Kevin Casteels (University of Victoria (CA))

Presentation materials