July 28, 2020 to August 6, 2020
virtual conference
Europe/Prague timezone

Erratic server behavior detection using machine learning on basic monitoring metrics

Jul 31, 2020, 10:00 AM
20m
virtual conference

virtual conference

Talk 14. Computing and Data Handling Computing and Data Handling

Speaker

Martin Adam (Czech Academy of Sciences (CZ))

Description

With the explosion of the number of distributed applications, a new dynamic server environment emerged grouping servers into clusters, utilization of which depends on the current demand for the application. To provide reliable and smooth services it is crucial to detect and fix possible erratic behavior of individual servers in these clusters. Use of standard techniques for this purpose requires manual work and delivers sub-optimal results. Using only application agnostic monitoring metrics our machine learning based method analyzes the recent performance of the inspected server as well as the state of the rest of the cluster, thus checking not only the behavior of the single server, but the load on the whole distributed application as well. We have implemented our method in a Spark job running in the CERN MONIT infrastructure. In this contribution we present results of testing multiple machine learning algorithms and pre-processing techniques to identify the servers erratic behavior. We also discuss the challenges of deploying our new method into production.

Primary author

Martin Adam (Czech Academy of Sciences (CZ))

Co-authors

Dagmar Adamova (Czech Academy of Sciences (CZ)) Luca Magnoni

Presentation materials