Jul 9 – 13, 2018
Sofia, Bulgaria
Europe/Sofia timezone

Using Fat Containers on HPCs for the ATLAS Experiment

Jul 10, 2018, 4:00 PM
Sofia, Bulgaria

Sofia, Bulgaria

National Culture Palace, Boulevard "Bulgaria", 1463 NDK, Sofia, Bulgaria
Poster Track 7 – Clouds, virtualization and containers Posters


Wei Yang (SLAC National Accelerator Laboratory (US))


CVMFS helps ATLAS in distributing software to the Grid, and isolating software lookup to batch nodes’ local filesystems. But CVMFS is rarely available in HPC environments. ATLAS computing has experimented with "fat" containers, and later developed an environment to produce such containers for both Shifter and Singularity. The fat containers include most of the recent ATLAS software releases, conditions database, and other tools extracted from CVMFS. The approach not only helped ATLAS to distribute software automatically to HPCs with an environment identical to those in CVMFS, but also significantly reduced the metadata I/O to HPCs’ shared filesystems. The production operation at NERSC has proved that by using fat containers, we can both scale up to run many more jobs simultaneously, and transparently fit into the previously developed ATLAS operation methods.

Primary authors

Wei Yang (SLAC National Accelerator Laboratory (US)) Doug Benjamin (Duke University (US)) Taylor Childers (Argonne National Laboratory (US)) David Lesny (Univ. Illinois at Urbana Champaign (US)) Xin Zhao (Brookhaven National Laboratory (US))

Presentation materials