14–17 Jul 2025
Seattle, Washington
US/Pacific timezone

HEP Packaging Coordination: Reproducible reuse by default

15 Jul 2025, 10:15
20m
Seattle, Washington

Seattle, Washington

University of Washington

Speaker

Matthew Feickert (University of Wisconsin Madison (US))

Description

While advancements in software development practices across particle physics and adoption of Linux container technology have made substantial impact in the ease of replicability and reuse of analysis software stacks, the underlying software environments are still primarily bespoke builds that lack a full manifest to ensure reproducibility across time. The HEP Packaging Coordination community project is bootstrapping packaging of the broader community ecosystem on conda-forge. This process covers multi-platform packaging from low level language phenomenology tools, to the broader simulation stack, to end user analysis tools, and the reinterpretation ecosystem. When combined with next generation scientific package management and manifest tools, the creation of fully specified, portable, and trivially reproducible environments becomes easy and fast, even with the use of hardware accelerators. This ongoing process significantly lowers technical barriers across tool development, distribution, and use, and when combined with public data products provides a transparent system for full analysis reinterpretation and reuse.

This also represents an opportunity for the PyHEP community to ensure that Pythonic community tooling can be robustly distributed for multiple computing platforms across Python package indexes (e.g. PyPI), conda package index (e.g. conda-forge), and as bespoke overlays through CVMFS. Supporting these distribution methods will allow for Analysis Facility managers and end user physicists alike to build complex scientific computing environments with confidence of stability and speed.

Author

Matthew Feickert (University of Wisconsin Madison (US))

Co-authors

Chris Burr (CERN) Dr Giordon Holtsberg Stark (University of California,Santa Cruz (US)) Henry Fredrick Schreiner (Princeton University) Lindsey Gray (Fermi National Accelerator Lab. (US))

Presentation materials