Oct 17 – 21, 2016
LBNL
US/Pacific timezone

On-demand provisioning of HEP compute resources on cloud sites and shared HPC centers

Oct 21, 2016, 9:00 AM
25m
Building 50 Auditorium (LBNL)

Building 50 Auditorium

LBNL

Berkeley, CA 94720
Grid, Cloud & Virtualisation Grid, Cloud and Virtualisation

Speaker

Andreas Petzold (KIT - Karlsruhe Institute of Technology (DE))

Description

This contribution reports on solutions, experiences and recent developments with the dynamic, on-demand provisioning of remote computing resources for analysis and simulation workflows. Local resources of a physics institute are extended by private and commercial cloud sites, ranging from the inclusion of desktop clusters over institute clusters to HPC centers.

We report on recent experience from incorporating a remote HPC center (NEMO Cluster, Freiburg University) and resources dynamically requested from a commercial provider (1&1 Internet SE), which have been seamlessly tied together with the ROCED scheduler [1] such that, from the user perspective, local and remote resources form a uniform, virtual computing cluster with a single point-of-entry. On a local test system, the usage of Docker containers has been explored and shown to be a viable and light-weight alternative to full virtualization solutions in trusted environments.

[1] O. Oberst et al. Dynamic Extension of a Virtualized Cluster by using Cloud
Resources, J. Phys.: Conference Ser. 396(3)032081, 2012

Primary author

Manuel Giffels (KIT - Karlsruhe Institute of Technology (DE))

Co-author

Andreas Petzold (KIT - Karlsruhe Institute of Technology (DE))

Presentation materials