FTS3: Data Movement Service in containers deployed in OKD

20 May 2021, 16:05
13m
Short Talk Distributed Computing, Data Management and Facilities Virtualisation

Speaker

Lorena Lobato Pardavila (Fermi National Accelerator Lab. (US))

Description

The File Transfer Service (FTS3) is a data movement service developed at CERN which is used to distribute the majority of the Large Hadron Collider's data across the Worldwide LHC Computing Grid (WLCG) infrastructure. At Fermilab, we have deployed FTS3 instances for Intensity Frontier experiments (e.g. DUNE) to transfer data in America and Europe, using a container-based strategy. In this article we summarize our experience building docker images based on work from the SLATE project (slateci.io) and deployed in OKD, the community distribution of Red Hat OpenShift. Additionally, we discuss our method of certificate management and maintenance utilizing Kubernetes CronJobs. Finally, we also report on the two different configurations currently running at Fermilab, comparing and contrasting a Docker-based OKD deployment against a traditional RPM-based deployment.

Primary authors

Dr Burt Holzman (Fermi National Accelerator Lab. (US)) Edward Karavakis (CERN) Lorena Lobato Pardavila (Fermi National Accelerator Lab. (US)) Steven Timm (Fermi National Accelerator Lab. (US)) lincoln bryant

Presentation materials

Proceedings

Paper