A New Petabyte-scale Data Derivation Framework for ATLAS

Apr 14, 2015, 2:15 PM
Auditorium (Auditorium)



oral presentation Track2: Offline software Track 2 Session


James Catmore (University of Oslo (NO))


During the Long shutdown of the LHC, the ATLAS collaboration overhauled its analysis model based on experience gained during Run 1.  A significant component of the model is a "Derivation Framework" that takes the Petabyte-scale AOD output from ATLAS reconstruction and produces samples, typically Terabytes in size, targeted at specific analyses.  The framework incorporates all of the functionality of the core reconstruction software, while producing outputs that are simply configured.  Event selections are specified via strings, including support for logical operations.  The output content can be highly optimised to minimise disk requirements, while maintaining the same C++ interface.  The framework includes an interface to the late-stage physics analysis tools, ensuring that the final outputs are consistent with tool requirements.  Finally, the framework allows several outputs to be produced for the same input, providing the possibility to optimise configurations to computing resources.

Primary author

Paul James Laycock (University of Liverpool (GB))


Dr Eirik Gramstad (University of Oslo (NO)) Graeme Stewart (University of Glasgow (GB)) Dr Jack Cranshaw (Argonne National Laboratory (US)) James Catmore (University of Oslo (NO)) Ms Nurcan Ozturk (University of Texas at Arlington) Thomas Gillam (University of Cambridge (GB))

Presentation materials