Mar 21 – 27, 2009
Europe/Prague timezone

ATLAS@Amazon Web Services: Running ATLAS software on the Amazon Elastic Compute Cloud

Mar 24, 2009, 8:00 AM


Prague Congress Centre 5. května 65, 140 00 Prague 4, Czech Republic
Board: Tuesday 062
poster Hardware and Computing Fabrics Poster session


Stefan Kluth (Max-Planck-Institut für Physik)


We show how the ATLAS offline software is ported on the Amazon Elastic Compute Cloud (EC2). We prepare an Amazon Machine Image (AMI) on the basis of the standard ATLAS platform Scientific Linux 4 (SL4). Then an instance of the SLC4 AMI is started on EC2 and we install and validate a recent release of the ATLAS offline software distribution kit. The installed software is archived as an image on the Amazon Simple Storage Service (S3) and can be quickly retrieved and connected to new SL4 AMI instances using the Amazon Elastic Block Store (EBS). ATLAS jobs can then configure against the release kit using the ATLAS configuration management tool (cmt) in the standard way. The output of jobs is exported to S3 before the SL4 AMI is terminated. Job status information is transferred to the Amazon SimpleDB service. The whole process of launching instances of our AMI, starting, monitoring and stopping jobs and retrieving job output from S3 is controlled from a client machine using python scripts implementing the Amazon EC2/S3 API via the boto library working together with small scripts embedded in the SL4 AMI. We report our experience with setting up and operating the system using standard ATLAS job transforms.

Primary authors

Jan-Philip Gehrcke (Max-Planck-Institut für Physik) Stefan Kluth (Max-Planck-Institut für Physik) Stefan Stonjek (Max-Planck-Institut für Physik)

Presentation materials