Domenico Giordano, Benchmarking cloud resources

Wednesday 16 Dec 2015, 14:30 → 16:00 Europe/Zurich

28/S-029 (CERN)

WhiteArea lectures' twiki HERE

Performance measurements and monitoring are essential for the efficient use of computing resources as they allow selecting and validating the most effective resources for a given processing workflow. In a commercial cloud environment an exhaustive resource profiling has additional benefits due to the intrinsic variability of a virtualised environment. In this context resource profiling via initial benchmarking quickly allows to identify issues and mitigate them. Ultimately it provides additional information to compare the presumed performance of invoiced resources and the actual delivered performance as perceived at the client level.

In this report we will discuss the experience acquired in benchmarking commercial cloud resources during  production activities such as the recent ATLAS Monte Carlo production in Helix Nebula cloud providers. The workflow put in place to collect and analyse performance metrics will be described. Results of the comparison study among commonly used benchmark metrics will be also reported. Those common benchmarks span from generic open-source benchmarks (encoding algorithm and kernel compilers) to experiment specific benchmarks (ATLAS KitValidation) and fast benchmarks based on random number generation.

 

NB! Room booking:

https://indico.cern.ch/rooms/booking/CERN/245174/

 

 

WA_CommercialCloudBenchmark_giordano_indico.pdf