18–22 Jan 2016
UTFSM, Valparaíso (Chile)
Chile/Continental timezone

The ATLAS EventIndex: data flow and inclusion of other metadata

21 Jan 2016, 17:00
25m
UTFSM, Valparaíso (Chile)

UTFSM, Valparaíso (Chile)

Avenida España 1680, Valparaíso Chile
Oral Computing Technology for Physics Research Track 1

Speaker

Fedor Prokoshin (Federico Santa Maria Technical University (CL))

Description

The ATLAS EventIndex is the catalogue of the event-related metadata for the information obtained from the ATLAS detector. The basic unit of this information is event record, containing the event identification parameters, pointers to the files containing this event as well as trigger decision information. The main use case for the EventIndex are the event picking, providing information for the Event Service and data consistency checks for large production campaigns. The EventIndex employs the Hadoop platform for data storage and handling, as well as a messaging system for the collection of information. The information for the EventIndex is collected both at Tier-0, when the data are first produced, and from the GRID, when various types of derived data are produced. The EventIndex uses various types of auxiliary information from other ATLAS sources for data collection and processing: trigger tables from the condition metadata database (COMA), dataset information from the data catalog AMI and the Rucio data management system and information on production jobs from the ATLAS production system. The ATLAS production system is also used for the collection of event information from the grid jobs. EventIndex developments started in 2013 and in the middle of 2015 the system was commissioned and started collecting event metadata, as a part of ATLAS Distributed Computing operations.

Author

Fedor Prokoshin (Federico Santa Maria Technical University (CL))

Co-authors

Alvaro Fernandez Casani (Instituto de Fisica Corpuscular (ES)) Andrea Favareto (Università degli Studi e INFN Genova) Carlos Garcia Montoro (Instituto de Fisica Corpuscular (ES)) Dario Barberis (Università e INFN Genova (IT)) David Malon (Argonne National Laboratory (US)) Elizabeth Gallas (University of Oxford (GB)) Jack Cranshaw (Argonne National Laboratory (US)) Javier Sanchez (Instituto de Fisica Corpuscular (ES)) Jose Salt (Instituto de Fisica Corpuscular (ES)) Julius Hrivnac (Laboratoire de l'Accelerateur Lineaire (FR)) Rainer Toebbicke (CERN) Ruijun Yuan (Laboratoire de l'Accelerateur Lineaire (FR)) Santiago Gonzalez De La Hoz (Instituto de Fisica Corpuscular (ES)) Simon Ernesto Cardenas Zarate (Federico Santa Maria Technical University (CL))

Presentation materials

Peer reviewing

Paper

Paper files: