28 October 2013 to 1 November 2013
University Of Michigan
America/Detroit timezone

Future of Batch Processing at CERN

29 Oct 2013, 11:30
30m
340 West Hall (University Of Michigan)

340 West Hall

University Of Michigan

1085 S University Ave, Ann Arbor, MI 48109 US
Oral presentation Computing & Batch Services Computing and batch systems

Speaker

Jerome Belleman (CERN)

Description

The CERN Batch System is comprised of 4000 worker nodes, 60 queues and various types of large user communities. In light of the recent developments driven by the Agile Infrastructure and the more demanding processing needs, the Batch System will be faced with increasingly challenging scalability and flexibility needs. So as to prepare for these high expectations, the CERN Batch Team have been designing a framework to be able to easily subject the Batch System to different types of strains and scalability tests. This framework has been the testbed for a number of candidate batch systems, one of which will foster the future of batch processing at CERN. So far, SLURM, Condor and Grid Engine have been under evaluation. In this talk, we present the design of this test framework and the initial results of our evaluation of the aforementioned batch systems, from a scalability and an administrative perspective.

Primary author

Presentation materials