A New Petabyte-scale Data Derivation Framework for ATLAS

14 Apr 2015, 14:15
15m
Auditorium (Auditorium)

Auditorium

Auditorium

oral presentation Track2: Offline software Track 2 Session

Speaker

James Catmore (University of Oslo (NO))

Description

During the Long shutdown of the LHC, the ATLAS collaboration overhauled its analysis model based on experience gained during Run 1.  A significant component of the model is a "Derivation Framework" that takes the Petabyte-scale AOD output from ATLAS reconstruction and produces samples, typically Terabytes in size, targeted at specific analyses.  The framework incorporates all of the functionality of the core reconstruction software, while producing outputs that are simply configured.  Event selections are specified via strings, including support for logical operations.  The output content can be highly optimised to minimise disk requirements, while maintaining the same C++ interface.  The framework includes an interface to the late-stage physics analysis tools, ensuring that the final outputs are consistent with tool requirements.  Finally, the framework allows several outputs to be produced for the same input, providing the possibility to optimise configurations to computing resources.

Primary author

Paul James Laycock (University of Liverpool (GB))

Co-authors

Dr Eirik Gramstad (University of Oslo (NO)) Graeme Stewart (University of Glasgow (GB)) Dr Jack Cranshaw (Argonne National Laboratory (US)) James Catmore (University of Oslo (NO)) Ms Nurcan Ozturk (University of Texas at Arlington) Thomas Gillam (University of Cambridge (GB))

Presentation materials