21-25 May 2012
New York City, NY, USA
US/Eastern timezone

Data storage accounting and verification in LHC experiments

22 May 2012, 13:30
4h 45m
Rosenthal Pavilion (10th floor) (Kimmel Center)

Rosenthal Pavilion (10th floor)

Kimmel Center

Poster Distributed Processing and Analysis on Grids and Clouds (track 3) Poster Session

Speaker

Natalia Ratnikova (KIT - Karlsruhe Institute of Technology (DE))

Description

All major experiments at Large Hadron Collider (LHC) need to measure real storage usage at the Grid sites. This information is equally important for the resource management, planning, and operations. To verify consistency of the central catalogs, experiments are asking sites to provide full list of files they have on storage, including size, checksum, and other file attributes. Such storage dumps provided at regular intervals give a realistic view of the storage resource usage by the experiments. Regular monitoring of the space usage and data verification serve as additional internal checks of the system integrity and performance. Both the importance and the complexity of these tasks increase with the constant growth of the total data volumes during the active data taking period at the LHC. Developed common solutions help to reduce the maintenance costs both at the large Tier-1 facilities supporting multiple virtual organizations, and at the small sites that often lack manpower. We discuss requirements and solutions to the common tasks of data storage accounting and verification, and present experiment-specific strategies and implementations used within the LHC experiments according to their computing models.

Summary

Comparative analysis of the CMS, ATLAS, and LHCb solutions to the storage accounting and verification

Primary authors

Cedric Serfon (Ludwig-Maximilians-Univ. Muenchen (DE)) Elisa Lanciotti (CERN) Natalia Ratnikova (KIT - Karlsruhe Institute of Technology (DE))

Co-authors

Alberto Sanchez Hernandez (Centro Invest. Estudios Avanz. IPN (MX)) Dr Chih-Hao Huang (Fermi National Accelerator Laboratory) Nicolo Magini (CERN) Dr Tony Wildish (Princeton University (US)) xiaomei zhang (IHEP,Beijing)

Presentation Materials