Second K8s-HEP Meetup

Session

block 1 - presentations

1 Dec 2020, 09:00

Virtual (Zoom)

1. Welcome! What's this?

Lincoln Bryant (University of Chicago (US)), Robert William Gardner Jr (University of Chicago (US))

01/12/2020, 09:00

9. Fermilab Experience with OKD (OpenShift)

Anthony Tiradani (Fermilab)

01/12/2020, 09:10

Fermilab has made the strategic decision to deploy OKD, the open source version of Red Hat OpenShift, for Kubernetes container management. We will discuss our experience so far with OKD and describe some of the challenges we faced deploying a variety of applications.

6. Debugging Kubernetes pod throughput with Calico CNI

Mr Thomas George Hartland (CERN)

01/12/2020, 09:30

Exploring how the kubelet, with Calico as the CNI plugin,
depends on the performance of the Kubernetes API server
to be able to start pods quickly.

2. K8s autoscaling based on custom metrics. Two examples of application: CMSWEB and HTCondor in the CMS Analysis Facility@INFN

Tommaso Tedeschi (Universita e INFN, Perugia (IT))

01/12/2020, 09:50

At the moment, Kubernetes only supports horizontal pod autoscaling based on predefined pod metrics (CPU and memory usage). Therefore, in order to achieve an actually green elastic cloud model (optimizing resource usage) a key point is to integrate this tool with autoscaling solutions based on custom metrics, and this requires the usage of third-party elements.
In this work we show the...

3. Lightweight integration of Kubernetes clusters for ATLAS batch processing

Fernando Harald Barreiro Megino (University of Texas at Arlington)

01/12/2020, 10:10

The PanDA team has evaluated the possibility of native Kubernetes job submission in order to process ATLAS workloads and offer the possibility of immediate integration of major cloud computing providers. This model also offers a novel way to set up lightweight compute sites, without the need of setting up a Grid stack.

During the last year we have been running several queues at clusters...

10. Lazy Image Pulling with Stargz

Spyridon Trigazis (CERN)

01/12/2020, 10:30

Container images allowed having reproducible environments and container orchestration lets users parallelize and create elaborate workflows with tools like Argo or just Kubernetes jobs. It is easy to create very large images and when parallelizing jobs, the time and cost of pulling container images can increase significantly. Golang developers proposed the seekable tar gunzip format...