10–14 Oct 2016
San Francisco Marriott Marquis
America/Los_Angeles timezone

Optimizing the resource usage in Cloud based environments: the Synergy approach

13 Oct 2016, 15:30
1h 15m
San Francisco Marriott Marquis

San Francisco Marriott Marquis

Poster Track 7: Middleware, Monitoring and Accounting Posters B / Break

Speaker

Lisa Zangrando (Universita e INFN, Padova (IT))

Description

Managing resource allocation in a Cloud based data center serving multiple virtual organizations is a challenging issue. In fact, while batch systems are able to allocate resources to different user groups according to specific shares imposed by the data center administrators, without a static partitioning of such resources, this is not so straightforward in the most common Cloud frameworks, e.g. OpenStack.
In the current OpenStack implementation, it is only possible to grant fixed quotas to the different user groups and these resources cannot be exceeded by one group even if there are unused resources allocated to other groups. Moreover in the existing OpenStack implementation, when there are no resources available, new requests are simply rejected: it is then up to the user to later re-issue the request. The recently started EU-funded INDIGO-DataCloud project is addressing this issue through ‘Synergy’, a new advanced scheduling service targeted for OpenStack.
In the past we solved the same problem by adopting the batch systems and today, with Synergy, we adopt the same approach by implementing in OpenStack the advanced scheduling logic based on the SLURM fair-share algorithm. This model for resource provisioning ensures that resources are distributed among users following precise shares defined by the administrator. The shares are average values to be guaranteed in a given time window by using an algorithm that takes into account the past usage of such resources.
We present the architecture of Synergy, the status of its implementation, some preliminary results and the foreseen evolution of the service.

Primary Keyword (Mandatory) Cloud technologies
Secondary Keyword (Optional) Computing middleware

Primary author

Lisa Zangrando (Universita e INFN, Padova (IT))

Co-authors

Federica Fanzago (Unknown) Marco Verlato (Universita e INFN, Padova (IT)) Massimo Sgaravatto (Universita e INFN, Padova (IT)) Dr Vincent Llorens (CNRS)

Presentation materials