CERN Accelerating science

Talk
Title Analysing I/O bottlenecks in LHC data analysis on grid storage resources
Video
Loading
If you experience any problem watching the video, click the download button below
Download Embed
Mp4:High
(600 kbps)
Windows Media:Medium
(480 kbps)
Flash:High
(753 kbps)
High-resolution:
Copy-paste this code into your page:
Author(s) Bhimji, Wahid (speaker) (University of Edinburgh (GB))
Corporate author(s) CERN. Geneva
Imprint 2012-05-22. - Streaming video, 00:22:55:00.
Series (Conferences)
(Computing in High Energy and Nuclear Physics (CHEP) 2012)
Lecture note on 2012-05-22T13:30:00
Subject category Conferences
Abstract We describe recent I/O testing frameworks that we have developed and applied within the UK GridPP Collaboration, the ATLAS experiment and the DPM team, for a variety of distinct purposes. These include benchmarking vendor supplied storage products, discovering scaling limits of SRM solutions, tuning of storage systems for experiment data analysis, evaluating file access protocols, and exploring IO read patterns of experiment software and their underlying event data models. With multiple grid sites now dealing with petabytes of data, such studies are becoming increasingly essential. We describe how the tests build, and improve, on previous work and contrast how the use-cases differ. We also detail the results obtained and the implications for storage hardware, middleware and experiment software.
Copyright/License © 2012-2024 CERN
Submitted by jd@bnl.gov

 


 Record created 2012-07-09, last modified 2022-11-02


External links:
Download fulltextTalk details
Download fulltextEvent details