Oct 16 – 20, 2017
KEK
Asia/Tokyo timezone

Using Docker containers for scientific environments - on-premises and in the cloud

Oct 18, 2017, 3:10 PM
20m
KEK

KEK

1-1 Oho, Tsukuba, Ibaraki 305-0801 Japan 36°09'01.0"N 140°04'28.1"E 36.150290, 140.074485
Grid, Cloud & Virtualisation Clouds, virtualisation, grids

Speaker

Sergey Yakubov (DESY)

Description

Docker container virtualization provides an efficient way to create isolated scientific environments, adjusted and optimized for a specific problem or a specific group of users. It allows to efficiently separate responsibilities - with IT focusing on infrastructure for image repositories, preparation of basic images, container deployment and scaling, and physicists focusing on application development in environment of their choice.

Depending on demand, compute resources can be dynamically provisioned and a containerised scientific environment can be deployed in a matter of seconds on a user laptop, a batch farm, an HPC cluster or a cloud without need for a user to learn new environment, install additional libraries, resolve dependencies, recompile applications.

The present talk will describe DESY's experience with providing Docker service on our HPC cluster and report progress in using cloud to transparently and elastically extend containerised scientific environments - a work being done within the HELIX NEBULA Science Cloud project.

Desired length 15

Primary authors

Sergey Yakubov (DESY) Mr Martin Gasthuber (DESY) Birgit Lewendel (Deutsches Elektronen-Synchrotron (DE))

Presentation materials