21–25 May 2012
New York City, NY, USA
US/Eastern timezone

The ATLAS ROOT-based data formats: recent improvements and performance measurements

21 May 2012, 17:25
25m
Room 905/907 (Kimmel Center)

Room 905/907

Kimmel Center

Parallel Event Processing (track 2) Event Processing

Speaker

Wahid Bhimji (University of Edinburgh (GB))

Description

We detail recent changes to ROOT-based I/O within the ATLAS experiment. The ATLAS persistent event data model continues to make considerable use of a ROOT I/O backend through POOL persistency. Also ROOT is used directly in later stages of analysis that make use of a flat-ntuple based "D3PD" data-type. For POOL/ROOT persistent data, several improvements have been made including implementation of automatic basket optimisation, memberwise streaming, and changes to split and compression levels. Optimisations are also planned for the D3PD format. We present a full evaluation of the resulting performance improvements from these, including in the case of selected retrieval of events. We also evaluate ongoing changes internal to ROOT, in the ATLAS context, for both POOL and D3PD data. We report results not only from test systems, but also utilising new automated tests on real ATLAS production resources which employ a wide range of storage technologies.

Primary author

Co-authors

Dr David Malon (Argonne National Laboratory (US)) Ilija Vukotic (Universite de Paris-Sud 11 (FR)) Dr Jack Cranshaw (Argonne National Laboratory (US)) Peter Van Gemmeren (Argonne National Laboratory (US)) R D Schaffer (Universite de Paris-Sud 11 (FR)) Wahid Bhimji (University of Edinburgh (GB))

Presentation materials