23–27 Mar 2015
Physics Department, Oxford University
Europe/London timezone

Running ATLAS at scale on Amazon EC2

26 Mar 2015, 16:05
25m
Martin Wood Lecture Theatre, Parks Road (Physics Department, Oxford University)

Martin Wood Lecture Theatre, Parks Road

Physics Department, Oxford University

Grid, Cloud & Virtualisation Grids, Clouds and Virtualisation

Speaker

John Hover (Brookhaven National Laboratory (BNL)-Unknown-Unknown)

Description

Beginning in September 2014, the RACF at Brookhaven National Lab has been collaborating with Amazon's scientific computing group in a pilot project. The goal of this project is to demonstrate the usage of Amazon AWS (EC2, S3, etc.) for real-world ATLAS production. This will prove the practical and economic feasibility of ATLAS beginning to leverage commercial cloud computing to optimize resource provisioning. This project includes all elements needed for at-scale work: networking, data management, capacity provisioning, VM image creation and management, and alterations/additions to ATLAS compute infrastructure to leverage AWS. Each of these elements is established for all three AWS regions (east, west-1, and west-2). The work done so far, the results of initial scaling tests, and plans for the near future will be presented in detail.

Summary

An overview of an ATLAS pilot project to demonstrate full-scale usage of Amazon AWS for scientific data analysis for ATLAS.

Author

John Hover (Brookhaven National Laboratory (BNL)-Unknown-Unknown)

Presentation materials