14-18 October 2013
Amsterdam, Beurs van Berlage
Europe/Amsterdam timezone

Optimizing High-Latency I/O in CMSSW

17 Oct 2013, 13:30
20m
Administratiezaal (Amsterdam, Beurs van Berlage)

Administratiezaal

Amsterdam, Beurs van Berlage

Oral presentation to parallel session Data Stores, Data Bases, and Storage Systems Data Stores, Data Bases, and Storage Systems

Speaker

Brian Paul Bockelman (University of Nebraska (US))

Description

To efficiently read data over high-latency connections, ROOT-based applications must pay careful attention to user-level usage patterns and the configuration of the I/O layer. Starting in 2010, CMSSW began using and improving several ROOT "best practice" techniques such as enabling the TTreeCache object and avoiding reading events out-of-order. Since then, CMS has been deploying additional improvements not part of base ROOT, such as the removal of the TTreeCache startup penalty and significantly reducing the number of network roundtrips for sparse event filtering. CMS has also implemented an algorithm for multi-source reads using Xrootd. This new client layer splits ROOT read requests between active source servers based on recent server performance and issues these requests in parallel.

Primary author

Brian Paul Bockelman (University of Nebraska (US))

Co-author

Elizabeth Sexton-Kennedy (Fermi National Accelerator Lab. (US))

Presentation Materials