10–14 Oct 2016
San Francisco Marriott Marquis
America/Los_Angeles timezone

Analysis of empty ATLAS pilot jobs and subsequent resource usage on grid sites

11 Oct 2016, 15:30
1h 15m
San Francisco Marriott Marquis

San Francisco Marriott Marquis

Poster Track 7: Middleware, Monitoring and Accounting Posters A / Break

Speaker

Alessandra Forti (University of Manchester (GB))

Description

The pilot model employed by the ATLAS production system has been in use for many years. The model has proven to be a success, with many
advantages over push models. However one of the negative side-effects of using a pilot model is the presence of 'empty pilots' running
on sites, consuming a small amount of walltime and not running a useful payload job. The impact on a site can be significant, with
previous studies showing a total 0.5% walltime usage with no benefit to either the site or to ATLAS. Another impact is the number of
empty pilots being processed by a site's Compute Element and batch system, which can be 5% of the total number of pilots being handled.
In this paper we review the latest statistics using both ATLAS and site data and highlight edge cases where the number of empty pilots
dominate. We also study the effect of tuning the pilot factories to reduce the number of empty pilots.

Primary Keyword (Mandatory) Computing middleware
Secondary Keyword (Optional) Computing facilities

Primary authors

Alessandra Forti (University of Manchester (GB)) Peter Love (Lancaster University (GB))

Presentation materials