Mar 23 – 27, 2015
Physics Department, Oxford University
Europe/London timezone

Deployment and usage of MCollective in production

Mar 26, 2015, 9:50 AM
Martin Wood Lecture Theatre, Parks Road (Physics Department, Oxford University)

Martin Wood Lecture Theatre, Parks Road

Physics Department, Oxford University

Basic IT Services Basic IT Services


Stefan Dietrich (DESY)


Marionette Collective, also known as MCollective, is a framework for building server orchestration, monitoring, and parallel job execution. MCollective uses a modern "Publish Subscribe Middleware" for a scalable and fast execution environment. It is a powerful tool in combination with Puppet, due to the good integration. However it can be a challenging task to configure and deploy MCollective in a reliable and secure way. In this talk, we will give an overview of our DESY MCollective setup, the design decisions, intended use and encountered problems.

Primary authors

Jan Dominik Engels (Deutsches Elektronen-Synchrotron (DE)) Stefan Dietrich (DESY)


Presentation materials