10-15 March 2019
Steinmatte conference center
Europe/Zurich timezone

The ATLAS EventIndex and its evolution towards LHC Run 3

12 Mar 2019, 16:30
20m
Steinmatte Plenary

Steinmatte Plenary

Oral Track 1: Computing Technology for Physics Research Track 1: Computing Technology for Physics Research

Speaker

Miguel Villaplana (Università degli Studi e INFN Milano (IT))

Description

The ATLAS experiment produced so far hundreds of petabytes of data and expects to have one order of magnitude more in the future. This data are spread among hundreds of computing Grid sites around the world. The EventIndex is the complete catalogue of all ATLAS events, real and simulated, keeping the references to all permanent files that contain a given event in any processing stage. It provides the means to select and access event data in the ATLAS distributed storage system, and provides support for completeness and consistency checks and trigger and offline selection overlap studies. The EventIndex employs various data handling technologies like Hadoop and Oracle databases, and is integrated with other systems of the ATLAS distributed computing infrastructure, including those for data, metadata, and production management. The project is in operation since the start of LHC Run 2 in 2015, and is in permanent development in order to fit the production and analysis demands and follow technology evolutions. The main data store in Hadoop, based on MapFiles and HBase, has worked well during Run 2 but new solutions are explored for the future. This paper reports on the current system performance and on the studies of a new data storage prototype that can carry the EventIndex through Run 3.

Primary authors

Dario Barberis (Università e INFN Genova (IT)) Evgeny Alexandrov (Joint Institute for Nuclear Research (RU)) Igor Aleksandrov (Joint Institute for Nuclear Research (JINR)) Zbigniew Baranowski (CERN) Gancho Dimitrov (CERN) Alvaro Fernandez Casani (Univ. of Valencia and CSIC (ES)) Elizabeth Gallas (University of Oxford (GB)) Carlos Garcia Montoro (Univ. of Valencia and CSIC (ES)) Santiago González de la Hoz (IFIC-Valencia) Julius Hrivnac (Universite de Paris-Sud 11 (FR)) Alexander Iakovlev (Joint Inst. for Nuclear Research (JINR)) Andrei Kazymov (Joint Institute for Nuclear Research (RU)) Mikhail Mineev (Joint Institute for Nuclear Research (RU)) Fedor Prokoshin (Federico Santa Maria Technical University (CL)) Grigori Rybkin (Universite de Paris-Sud 11 (FR)) Javier Sanchez (Univ. of Valencia and CSIC (ES)) Jose Salt (Univ. of Valencia and CSIC (ES)) Petya Vasileva (PU) Miguel Villaplana (Università degli Studi e INFN Milano (IT))

Presentation materials

Peer reviewing

Paper