Jul 9 – 13, 2018
Sofia, Bulgaria
Europe/Sofia timezone

The Cherenkov Telescope Array production system for data-processing and Monte Carlo simulation

Jul 12, 2018, 11:45 AM
15m
Hall 7 (National Palace of Culture)

Hall 7

National Palace of Culture

presentation Track 3 – Distributed computing T3 - Distributed computing

Speaker

Luisa Arrabito

Description

The Cherenkov Telescope Array (CTA) is the next-generation instrument in the field of very high energy gamma-ray astronomy. It will be composed of two arrays of Imaging Atmospheric Cherenkov Telescopes, located at La Palma (Spain) and Paranal (Chile). The construction of CTA has just started with the installation of the first telescope on site at La Palma and the first data expected by the end of 2018. The scientific operations should begin in 2022 for a duration of about 30 years. The overall amount of data produced during these operations is of about 27 PB per year. The associated computing power for data processing and Monte Carlo (MC) simulations is of the order of hundreds of millions of CPU HS06 hours per year.
In order to cope with these high computing requirements, we have developed a production system prototype based on the DIRAC framework, that we have intensively exploited during the past 5 years to handle massive MC simulations on the grid needed for the CTA design and prototyping phases.
However, CTA workflows are quite complex and composed of several interdependent steps, which we used to handle separately within our production system. In order to fully automatize the whole workflows execution, we have partially revised the production system by further enhancing the data-driven behaviour and by extending the use of meta-data to link together the different steps of a workflow.
In this contribution we present the application of the production system to the last years MC campaigns as well as the recent production system evolution, intended to obtain a fully data-driven and automatized workflow execution for an efficient processing of real telescope data.

Primary authors

Luisa Arrabito Konrad Bernloehr (Max-Planck-Institut fur Kernphysik, P.O. Box 103980, D-69029 Heidelberg, Germany) Johan Bregeon (Laboratoire Univers et Particules, Université de Montpellier Place Eugène Bataillon - CC 72, CNRS/IN2P3, F-34095 Montpellier, France ) Paolo Cumani (Institut de Fisica d’Altes Energies (IFAE), The Barcelona Institute of Science and Technology, Campus UAB, 08193 Bellaterra Barcelona, Spain
) Tarek Hassan (Institut de Fisica d’Altes Energies (IFAE), The Barcelona Institute of Science and Technology, Campus UAB, 08193 Bellaterra Barcelona, Spain
) Andreas Haupt (Deutsches Elektronen-Synchrotron, Platanenallee 6, 15738 Zeuthen, Germany ) Gernot Maier (Deutsches Elektronen-Synchrotron, Platanenallee 6, 15738 Zeuthen, Germany ) Tino Michael (CEA Saclay, IRFU/SAp, 91191 Orme des Merisiers, France) Abelardo Moralejo (Institut de Fisica d’Altes Energies (IFAE), The Barcelona Institute of Science and Technology, Campus UAB, 08193 Bellaterra Barcelona, Spain) Nadine Neyroud Federico Stagni (CERN) Andrei Tsaregorodtsev (Aix Marseille Univ, CNRS/IN2P3, CPPM, Marseille, France)

Presentation materials