Using the glideinWMS System as a Common Resource Provisioning Layer in CMS

13 Apr 2015, 15:00
15m
B250 (B250)

B250

B250

oral presentation Track4: Middleware, software development and tools, experiment frameworks, tools for distributed computing Track 4 Session

Speaker

James Letts (Univ. of California San Diego (US))

Description

CMS will require access to more than 125k processor cores for the beginning of Run2 in 2015 to carry out its ambitious physics program with more and higher complexity events. During Run1 these resources were predominantly provided by a mix of grid sites and local batch resources. During the long shut down cloud infrastructures, diverse opportunistic resources and HPC supercomputing centers were made available to CMS, which further complicated the operations of the submission infrastructure. In this presentation we will discuss the CMS effort to adopt and deploy the glideinWMS system as a common resource provisioning layer to grid, cloud, local batch, and opportunistic resources and sites. We will address the challenges associated with integrating the various types of resources, the efficiency gains and simplifications associated with using a common resource provisioning layer, and discuss the solutions found. We will finish with an outlook of future plans for how CMS is moving forward on resource provisioning for more heterogenous architectures and services.

Primary author

Oliver Gutsche (Fermi National Accelerator Lab. (US))

Co-authors

Alison Mc Crea (Univ. of California San Diego (US)) Brian Paul Bockelman (University of Nebraska (US)) Christoph Wissing (Deutsches Elektronen-Synchrotron (DE)) Dr David Alexander Mason (Fermi National Accelerator Lab. (US)) Dr David Colling (Imperial College Sci., Tech. & Med. (GB)) Dirk Hufnagel (Fermi National Accelerator Lab. (US)) Farrukh Aftab Khan (National Centre for Physics (PK)) Mr Igor Sfiligoi (University of California San Diego) James Letts (Univ. of California San Diego (US)) Justas Balcas (Vilnius University (LT)) Krista Larson (Fermi National Accelerator Lab. (US)) Marco Mascheroni (Universita & INFN, Milano-Bicocca (IT)) Maria Dolores Saiz Santos (Univ. of California San Diego (US)) Stefan Piperov (Brown University (US)) Stefano Belforte (Universita e INFN (IT))

Presentation materials