14–18 Oct 2013
Amsterdam, Beurs van Berlage
Europe/Amsterdam timezone

Evolution of the pilot infrastructure of CMS: towards a single glideinWMS pool

14 Oct 2013, 15:00
45m
Grote zaal (Amsterdam, Beurs van Berlage)

Grote zaal

Amsterdam, Beurs van Berlage

Poster presentation Distributed Processing and Data Handling A: Infrastructure, Sites, and Virtualization Poster presentations

Speaker

Ian Fisk (Fermi National Accelerator Lab. (US))

Description

CMS production and analysis job submission is based largely on glideinWMS and pilot submissions. The transition from multiple different submission solutions like gLite WMS and HTCondor-based implementations was carried out over years and is coming now to a conclusion. The historically explained separate glideinWMS pools for different types of production jobs and analysis jobs are being unified into a single global pool. This enables CMS to benefit from global prioritization and scheduling possibilities. It also presents the sites with only one kind of pilots and eliminates the need of having to make scheduling decisions on the CE level. This paper provides an analysis of the benefits of a unified resource pool, as well as a description of the resulting global policy. It will explain the technical challenges moving forward and present solutions to some of them.

Primary authors

Ian Fisk (Fermi National Accelerator Lab. (US)) Oliver Gutsche (Fermi National Accelerator Lab. (US))

Presentation materials