Speaker
Natalia Ratnikova
(KIT - Karlsruhe Institute of Technology (DE))
Description
All major experiments at Large Hadron Collider (LHC) need to measure real storage usage at the Grid sites. This information is equally important for the resource management, planning, and operations.
To verify consistency of the central catalogs, experiments are asking sites to provide full list of files they have on storage, including size, checksum, and other file attributes. Such storage dumps provided at regular intervals give a realistic view of the storage resource usage by the experiments. Regular monitoring of the space usage and data verification serve as additional internal checks of the system integrity and performance. Both the importance and the complexity of these tasks increase with the constant growth of the total data volumes during the active data taking period at the LHC.
Developed common solutions help to reduce the maintenance costs both at the large Tier-1 facilities supporting multiple virtual organizations, and at the small sites that often lack manpower.
We discuss requirements and solutions to the common tasks of data storage accounting and verification, and present experiment-specific strategies and implementations used within the LHC experiments according to their computing models.
Summary
Comparative analysis of the CMS, ATLAS, and LHCb solutions to the storage accounting and verification
Authors
Cedric Serfon
(Ludwig-Maximilians-Univ. Muenchen (DE))
Elisa Lanciotti
(CERN)
Natalia Ratnikova
(KIT - Karlsruhe Institute of Technology (DE))
Co-authors
Alberto Sanchez Hernandez
(Centro Invest. Estudios Avanz. IPN (MX))
Dr
Chih-Hao Huang
(Fermi National Accelerator Laboratory)
Nicolo Magini
(CERN)
Dr
Tony Wildish
(Princeton University (US))
xiaomei zhang
(IHEP,Beijing)
