14–18 Oct 2019
Amsterdam Science Park Congress Centre
Europe/Amsterdam timezone

Running an HTC cluster with fully containerised jobs using HTCondor, Singularity, CephFS and CVMFS

15 Oct 2019, 14:00
25m
Turingzaal (Amsterdam Science Park Congress Centre)

Turingzaal

Amsterdam Science Park Congress Centre

Science Park 123 1098 XG Amsterdam The Netherlands 52°21'23"N, 4°57'7"E
Computing & Batch Services Computing and Batch Services

Speaker

Peter Wienemann (University of Bonn (DE))

Description

In this talk we present an HTC cluster which has been set up
at Bonn University in 2017/2018. On this fully-puppetised cluster all jobs
are run inside Singularity containers. Job management is handled
by HTCondor which nicely shields the container setup from the users.
The users only have to choose the desired OS via a job parameter from an
offered collection of container images. The container images along with
various software packages are provided by a CernVM filesystem (CVMFS).
The data to be analysed is stored on a CephFS file system.

The presentation describes how the various components are set up and
provides some operational experience with this cluster.

Desired slot length 20
Speaker release Yes

Authors

Oliver Freyermuth (University of Bonn (DE)) Peter Wienemann (University of Bonn (DE))

Presentation materials