Speaker
Description
As HEP experiments increasingly rely on diverse computing resources across multiple facilities, sustainable workflow orchestration that bridges experiment-native tools with facility-native interfaces becomes critical. This work develops and evaluates a generalizable approach to cross-facility workflow integration, using the DUNE 2×2 Near Detector simulation as a challenging demonstrator case.
We present a study of integration between JustIN, the DUNE workflow management system, and the NERSC Superfacility API—NERSC's programmatic interface for HPC job submission and storage systems—, demonstrating a new approach to executing HEP simulation campaigns on leadership-class HPC facilities. This work extends previous portability efforts—which brought the DUNE 2×2 Near Detector simulation chain to HPCs like Perlmutter, Polaris, and Frontier—by addressing what we term the "workflow-management dimension" of portability: the challenge of bridging experiment-native orchestration tools with facility-native job submission interfaces.
The DUNE 2×2 ND simulation chain stress-tests workflow portability by coupling CPU- and GPU-intensive stages, depending on CVMFS-distributed software, and requiring access to external databases and metadata services. JustIN orchestrates data-driven, multi-stage campaigns using standard HEP ecosystem components for data management (Rucio), metadata handling (MetaCat), and distributed job execution (HTCondor/GlideinWMS), while the Superfacility API provides programmatic access to job submission, data movement, and monitoring on Perlmutter.
Our study executes JustIN workflow stages on Perlmutter through Superfacility-driven wrapper jobs. We characterize challenges specific to this integrated setting—including token and identity propagation across trust boundaries, duplicated monitoring and bookkeeping, and mismatches between pilot-based and facility-native job models—and present mitigation strategies using thin adapter layers and container overlays. We outline a design for extending this approach to other facilities adopting Integrated Research Infrastructure (IRI) API patterns. The resulting lessons offer a reusable template for HEP experiments seeking sustainable, cross-facility workflow orchestration without abandoning their existing toolchains.