Jul 9 – 13, 2018
Sofia, Bulgaria
Europe/Sofia timezone

Bulding, testing and distributing common software for the LHC experiments

Jul 12, 2018, 11:00 AM
Hall 3 (National Palace of Culture)

Hall 3

National Palace of Culture

presentation Track 5 – Software development T5 - Software development


Patricia Mendez Lorenzo (CERN)


Building, testing and deploying of coherent large software stacks is very challenging, in particular when they consist of the diverse set of packages required by the LHC experiments, the CERN Beams department and data analysis services such as SWAN. These software stacks include several packages (Grid middleware,Monte Carlo generators, Machine Learning tools, Python modules) all required for a large number of compilers,operating systems and hardware architectures.

To address this challenge, we developed an infrastructure around a tool, called ‘lcgcmake’. Dedicated modules are responsible for building the packages, controlling the dependencies in a reliable and scalable way. The distribution relies on a robust automatic system, responsible for building and testing the packages, installing them on CernVM-FS and packaging the binaries in RPMs and tarballs. This system is orchestrated through Jenkins on build machines provided by the CERN Openstack facility. The results are published through user-friendly web pages.

In this talk we will present an overview of this infrastructure tools and policies. We also discuss the role of this effort within the HEP Software Foundation (HSF). Finally we will discuss the evolution of the infrastructure towards container (Docker) technologies and the future directions and challenges of the project.

Primary authors

Patricia Mendez Lorenzo (CERN) Pere Mato Vila (CERN) Gerardo Ganis (CERN) Javier Cervantes Villanueva (CERN) Rafal Pacholek (AGH University of Science and Technology (PL)) Dmitri Konstantinov (Institute for High Energy Physics (RU)) Ivan Razumov (Institute for High Energy Physics (RU)) Grigorii Latyshev (Institute for High Energy Physics (RU))

Presentation materials