9-13 July 2018
Sofia, Bulgaria
Europe/Sofia timezone

Sharing server nodes for storage and compute

10 Jul 2018, 14:15
15m
Hall 10 (National Palace of Culture)

Hall 10

National Palace of Culture

presentation Track 8 – Networks and facilities T8 - Networks and facilities

Speaker

David Smith (CERN)

Description

Based on the observation of low average CPU utilisation of several hundred disk servers in the EOS storage system at CERN, the Batch on EOS Extra Resources (BEER) project developed an approach to utilise these resources for batch processing. After initial proof of concept tests, showing almost no interference between the batch and storage services, a model for production has been developed and implemented. This has been deployed on part the CERN EOS preproduction instance. The implementation and test results will be presented. The potential for additional resources at the CERN T0 centre is of the order of ten thousand hardware threads, as well as being a step towards a hyper-converged infrastructure.

Primary authors

Ben Jones (CERN) Mr Andrey Kirianov (Petersburg Nuclear Physics Institut (RU)) Massimo Lamanna (CERN) Luca Mascetti (CERN) Gavin McCance (CERN) Herve Rousseau (CERN) Markus Schulz (CERN) David Smith (CERN) Havard Tollefsen (Norwegian University of Science and Technology (NO))

Presentation Materials