Speaker
Luciano Orsini
(CERN)
Description
The CMS data acquisition system comprises of O(10000) of interdependent services that need to be
monitored in near real-time. The ability to monitor a large number of distributed applications
accurately and effectively is of paramount importance for operation.
Application monitoring entails the collection of a large number of simple and composed values
made available by the software components and hardware devices. A key aspect is that
detection of deviations from the specified behaviour is supported in a timely manner. This is a prerequisite
to take corrective actions efficiently.
Given the size and time constraints, efficient application monitoring is an interesting research problem. In this
article we are highlighting the limitations of existing solutions and we propose an approach that use
the emerging paradigm of Web-service based eventing systems in combination with hierarchical data collection
and load-balancing. Scalability and efficiency are achieved by a decentralized architecture, splitting up
data collections into regions of collections. An implementation following the presented scheme is
deployed as monitoring infrastructure of the CMS experiment at the Large Hadron Collider.
All services in this distributed data acquisition system are providing standard web service interfaces via
XML, SOAP and HTTP. Continuing on this path we adopted WS-* standards implementing a monitoring system
layered on top of the W3C standards stack. We designed a load-balanced publisher/subscriber system with
the ability to include high-speed protocols for efficient data transmission and serving data in multiple
data formats. We discuss the requirements for monitoring in LHC scale distributed data acquisition systems
and shed light on the implementation and it's performance.
Primary authors
Co-authors
Alexander Oh
(CERN, Geneva, Switzerland)
Andrea Petrucci
(University of California, San Diego, San Diego, California, USA)
Andreas Meyer
(DESY, Hamburg, Germany, CERN, Geneva, Switzerland)
Attila Racz
(CERN, Geneva, Switzerland)
Christian Deldicque
(CERN, Geneva, Switzerland)
Christoph Paus
(Massachusetts Institute of Technology, Cambridge, Massachusetts, USA)
Christoph Schwick
(CERN, Geneva, Switzerland)
Dennis Shpakov
(FNAL, Chicago, Illinois, USA)
Derek Hatton
(DESY, Hamburg, Germany)
Dominique Gigi
(CERN, Geneva, Switzerland)
Elizabeth Dusinberre
(University of California, San Diego, San Diego, California, USA)
Emilio Meschi
(CERN, Geneva, Switzerland)
Eric Cano
(CERN)
Fabiana Fortes Rodrigues
(Centro Federal de Educação Tecnológica Celso Suckow da Fonseca, Rio de Janeiro , Brazil.)
Frank Glege
(CERN, Geneva, Switzerland)
Frans Meijers
(CERN, Geneva, Switzerland)
Gerry Bauer
(Massachusetts Institute of Technology, Cambridge, Massachusetts, USA)
Hannes Sakulin
(CERN, Geneva, Switzerland)
Harry Cheung
(FNAL, Chicago, Illinois, USA)
James Branson
(University of California, San Diego, San Diego, California, USA)
Jean-Francois Laurens
(CERN, Geneva, Switzerland)
Joao Varela
(LIP, Lisbon, Portugal, CERN, Geneva, Switzerland)
Jose Antonio Coarasa
(CERN, Geneva, Switzerland, University of California, San Diego, San Diego, California, USA)
Juan Antonio Lopez Perez
(CERN, Geneva, Switzerland)
Konstanty Sumorok
(Massachusetts Institute of Technology, Cambridge, Massachusetts, USA)
Kurt Biery
(FNAL, Chicago, Illinois, USA)
Marco Pieri
(University of California, San Diego, San Diego, California, USA)
Marco Zanetti
(CERN, Geneva, Switzerland)
Marek Ciganek
(CERN)
Matteo Sani
(University of California, San Diego, San Diego, California, USA)
Philipp Schieferdecker
(CERN, Geneva, Switzerland)
Remigius K Mommsen
(FNAL, Chicago, Illinois, USA)
Robert Gomez-Reino
(CERN, Geneva, Switzerland)
Samim Erhan
(CERN, Geneva, Switzerland, University of California, Los Angeles, Los Angeles, California, USA)
Sean Simon
(University of California, San Diego, San Diego, California, USA)
Sergio Cittolin
(CERN, Geneva, Switzerland)
Ulf Behrens
(DESY, Hamburg, Germany)
Vaios Patras
(CERN, Geneva, Switzerland)
Vivian O'Dell
(FNAL, Chicago, Illinois, USA)
