14-18 May 2018
University of Wisconsin-Madison
America/Chicago timezone

Automatic for the People: Containers for LIGO software development on the Open Science Grid and other diverse computing resources

May 18, 2018, 11:30 AM
Chamberlin Hall (University of Wisconsin-Madison)

Chamberlin Hall

University of Wisconsin-Madison

Madison, USA 43°4'25.8024''N 89°24'18.7776''W 43.073834, -89.405216
Grid, Cloud & Virtualisation Clouds, virtualisation, grids


Dr Thomas Downes (University of Wisconsin-Milwaukee)


Distributed research organizations are faced with wide variation in computing environments to support. LIGO has historically resolved this problem by providing RPM/DEB packages for (pre-)production software and coordination between clusters operated by LIGO-affiliated facilities and research groups. This has been largely successful although it leaves a gap in operating system support and in the development process prior to formal point releases.

We describe early developments in LIGO’s use of GitLab, GitHub, and DockerHub to continuously deploy researcher-maintained containers for immediate use on all LIGO clusters, the Open Science Grid, and user workstations. Typical latencies are below an hour, dominated by the build-time of the software itself and the client refresh rate of the CernVM File System

Desired length 15 minutes

Primary author

Dr Thomas Downes (University of Wisconsin-Milwaukee)

Presentation materials