Nov 4 – 8, 2019
Adelaide Convention Centre
Australia/Adelaide timezone

The ATLAS EventIndex for LHC Run 3

Nov 7, 2019, 2:45 PM
15m
Riverbank R8 (Adelaide Convention Centre)

Riverbank R8

Adelaide Convention Centre

Oral Track 4 – Data Organisation, Management and Access Track 4 – Data Organisation, Management and Access

Speaker

Dario Barberis (Università e INFN Genova (IT))

Description

The ATLAS Event Index was designed in 2012-2013 to provide a global event catalogue and limited event-level metadata for ATLAS analysis groups and users during LHC Run 2 (2015-2018). It provides a good and reliable service for the initial use cases (mainly event picking) and several additional ones, such as production consistency checks, duplicate event detection and measurements of the overlaps of trigger chains and derivation datasets. LHC Run 3, starting in 2021, will see increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its limits by the end of Run 3. This talk describes the implementation of a new core storage service that will be able to provide at least the same functionality as the current one for increased data ingestion and search rates and with increasing volumes of stored data. It is based on a set of HBase tables, with schemas derived from the current Oracle implementation, coupled to Apache Phoenix for data access; in this way we will add to the advantages of a BigData based storage system the possibility of SQL as well as NoSQL data access, allowing us to re-use most of the existing code for metadata integration.

Consider for promotion No

Primary authors

Dario Barberis (Università e INFN Genova (IT)) Evgeny Alexandrov (Joint Institute for Nuclear Research (RU)) Igor Alexandrov (Joint Institute for Nuclear Research (RU)) Zbigniew Baranowski (CERN) Gancho Dimitrov (CERN) Alvaro Fernandez Casani (Univ. of Valencia and CSIC (ES)) Elizabeth Gallas (University of Oxford (GB)) Carlos García Montoro (IFIC) Santiago Gonzalez De La Hoz (Univ. of Valencia and CSIC (ES)) Julius Hrivnac (Centre National de la Recherche Scientifique (FR)) Andrei Kazymov (Joint Institute for Nuclear Research (RU)) Mikhail Mineev (Joint Institute for Nuclear Research (RU)) Dr Fedor Prokoshin (Joint Institute for Nuclear Research (RU)) Grigori Rybkin (Centre National de la Recherche Scientifique (FR)) Javier Sanchez (Universidad de Valencia (ES)) Jose Salt (Instituto de Fisica Corpuscular (IFIC) - Universidad de Valencia) Miguel Villaplana (Università degli Studi e INFN Milano (IT))

Presentation materials