9-13 July 2018
Sofia, Bulgaria
Europe/Sofia timezone

Spy-Agency service for monitoring of automated real-time calibration workflows and steering the injection of prompt reconstruction workflows at the CMS experiment

10 Jul 2018, 11:30
Hall 3.1 (National Palace of Culture)

Hall 3.1

National Palace of Culture

presentation Track 1 - Online computing T1 - Online computing


Arun Kumar (National Taiwan University (TW))


The calibration of the detector in almost real time is a key to the exploitation of the large data volumes at the LHC experiments. For this purpose the CMS collaboration deployed a complex machinery involving several components of the processing infrastructure and of the condition DB system. Accurate reconstruction of data start only once all the calibrations become available for consumption and relies on continuous and detailed monitoring of the calibration machinery and the physics performance of its products. This monitoring task requires to aggregate, digest, and react upon information from all the different components based on very heterogeneous technologies: the Tier0 processing farm, the Oracle based condition DB, the data quality monitoring framework and various other logging and bookkeeping services . An application has been designed and deployed to spy data from various sources. The application presents information to a web based interface and communicates the readiness of the calibrations to the computing infrastructure. A dedicated application, spying data from these various different sources, presenting them on a web based interface and able to communicate to the computing infrastructure the readiness for reconstruction of any chunk of data, has been designed and deployed. The presentation reports on the design choices and operational experience of this new tool.

Primary authors

Mr Sverre Herland (Norwegian University of Science and Technology (NO)) Gianluca Cerminara (CERN) Giovanni Franzoni (CERN) Arun Kumar (National Taiwan University (TW)) Giacomo Govi (Fermi National Accelerator Lab. (US)) Dr Luca Pernie (Texas A&M University)

Presentation Materials