Simulation of LHC events on a million threads

Apr 16, 2015, 11:45 AM
C210 (C210)



oral presentation Track8: Performance increase and optimization exploiting hardware features Track 8 Session


Taylor Childers (Argonne National Laboratory (US))


Demand for Grid resources is expected to double during LHC Run II as compared to Run I; the capacity of the grid, however, will not double. The HEP community must consider how to bridge this computing gap. Two approaches to meeting this demand include targeting larger compute resources, and using the available compute resources as efficiently as possible. Argonne’s Mira, the fifth fastest supercomputer in the world, can run roughly five times the number of parallel processes that the ATLAS experiment typically uses on the Grid. We have ported Alpgen, a serial x86 code, to run as a parallel application under MPI on the Blue Gene/Q architecture. By analysis of the Alpgen code, we reduced the memory footprint to allow running 64 threads per node, utilizing the four hardware threads available per core on the PowerPC A2 processor. Event generation and unweighting, typically run as independent serial phases, are coupled together in a single job in this scenario, reducing intermediate writes to the filesystem. By these optimizations, we have successfully run LHC proton-proton physics event generation at the scale of a million threads, filling two-thirds of Mira.

Primary authors

Doug Benjamin (Duke University (US)) Taylor Childers (Argonne National Laboratory (US)) Thomas Le Compte (Argonne National Laboratory (US)) Tom Uram (urn:Google)

Presentation materials