10-14 October 2016
San Francisco Marriott Marquis
America/Los_Angeles timezone

Integrating Containers in the CERN Private Cloud

12 Oct 2016, 12:30
Sierra C (San Francisco Mariott Marquis)

Sierra C

San Francisco Mariott Marquis

Oral Track 7: Middleware, Monitoring and Accounting Track 7: Middleware, Monitoring and Accounting


Ricardo Brito Da Rocha (CERN)


Containers remain a hot topic in computing, with new use cases and tools appearing every day. Basic functionality such as spawning containers seems to have settled, but topics like volume support or networking are still evolving. Solutions like Docker Swarm, Kubernetes or Mesos provide similar functionality but target different use cases, exposing distinct interfaces and APIs.

The CERN private cloud is made of thousands of nodes and users, with many different use cases. A single solution for container deployment would not cover every one of them, and supporting multiple solutions involves repeating the same process multiple times for integration with authentication services, storage services or networking.

In this presentation we will describe OpenStack Magnum as the solution to offer container management in the CERN cloud. We will cover its main functionality and some advanced use cases using Docker Swarm and Kubernetes, highlighting some relevant differences between the two. We will describe the most common use cases in HEP and how we integrated popular services like CVMFS or AFS in the most transparent way possible, along with some limitations found. Finally we will look into ongoing work on advanced scheduling for both Swarm and Kubernetes, support for running batch like workloads and integration of container networking technologies with the CERN infrastructure.

Primary Keyword (Mandatory) Cloud technologies
Secondary Keyword (Optional) Computing facilities
Tertiary Keyword (Optional) Virtualization

Primary author


Bertrand Noel (Ministere des affaires etrangeres et europeennes (FR)) Mathieu Velten (CERN)

Presentation Materials