10-14 October 2016
San Francisco Marriott Marquis
America/Los_Angeles timezone

First results from a combined analysis of CERN computing infrastructure metrics

11 Oct 2016, 12:00
GG A+B (San Francisco Mariott Marquis)


San Francisco Mariott Marquis

Oral Track 5: Software Development Track 5: Software Development


Oliver Keeble (CERN)


The IT Analysis Working Group (AWG) has been formed at CERN across individual computing units and the experiments to attempt a cross cutting analysis of computing infrastructure and application metrics. In this presentation we will describe the first results obtained using medium/long term data (1 months - 1 year) correlating box level metrics, job level metrics from LSF and HTCondor, I/O metrics from the physics analysis disk pools (EOS) and networking and application level metrics from the experiment dashboards.
We will cover in particular the measurement of hardware performance and prediction of job durations, the latency sensitivity of different job types and a search for bottlenecks with the production job mix in the current infrastructure. The presentation will conclude with the proposal of a small set of metrics to simplify drawing conclusions also in the more constrained environment of public cloud deployments.

Primary Keyword (Mandatory) Analysis tools and techniques
Secondary Keyword (Optional) Monitoring

Primary author


Christian Nieke (Brunswick Technical University (DE)) Oliver Keeble (CERN)

Presentation Materials

Your browser is out of date!

If you are using Internet Explorer, please use Firefox, Chrome or Edge instead.

Otherwise, please update your browser to the latest version to use Indico without problems.