Tutorial for Scientific Computing using Amazon

Monday 2 Feb 2015, 08:00 → 18:00 Europe/Zurich

30/7-018 - Kjell Johnsen Auditorium (CERN)

Maria Girone (CERN), Sanjay Padhi (Univ. of California San Diego (US))

1 Introduction to the hands-on workshop

Speakers: Dr Maria Girone (CERN), Sanjay Padhi (Univ. of California San Diego (US))

Slides spadhi_intro.pdf

2 Scientific Computing at Amazon

Speaker: Jamie Kinney (Amazon)

Slides 01_-_Scientific_Computing_at_Amazon.pdf

3 Hands-on tutorial to run basic CMS/Non-CMS related applications on EC2

Speakers: Jamie Kinney (Amazon), Sanjay Padhi (Univ. of California San Diego (US))

Slides 03_-_ECS-All-about-containers.pdf

11:00 Coffee break

4 Introduction to Storage, Data Transfer and Security Protocols at Amazon

Speaker: Jamie Kinney (Amazon)

Slides 02_-_Storage,_Data_Transfer_and_Security.pdf 04_-_Maximizing_Amazon_S3_Performance.pdf

5 CMS storage and security models, data transfers, PheDEX interoperability with AWS

Speaker: Dr Tony Wildish (Princeton University (US))

Slides 2015-02-02-PhEDEx-Amazon-tutorial.pdf 2015-02-02-PhEDEx-Amazon-tutorial.pptx

12:30 Lunch

6 CMS Distributed Analysis framework & Tutorial using Amazon resources

- User analysis workflow (CRAB) without inputs (Monte Carlo) - User analysis workflow (CRAB) with pre-staged input data

Speakers: Brian Paul Bockelman (University of Nebraska (US)), Marco Mascheroni (Universita & INFN, Milano-Bicocca (IT))

Slides CRAB3-EC2.pdf DemoAmazon.pdf

7 Introduction to both relational and non-relational databases available at Amazon

Speaker: Jamie Kinney (Amazon)

Slides 05_-_Advanced_Data_and_Analyitcs.pdf

8 Introduction to Amazon Monitoring and Auditing Systems

Speaker: Steven Bryen (Amazon)

Slides 07_-_Monitoring_101_(SB).pptx

9 Other developments related to user driven Tier-3 usage/model: OSG Connect

Speaker: Robert William Gardner Jr (University of Chicago (US))

Slides OSG_Connect_CMS-Amazon.pdf

16:10 Coffee break

10 Challenges in using Amazon for Scientific Computing

Speaker: Ian Fisk (Fermi National Accelerator Lab. (US))

Slides Amazon_Cloud.pdf

11 Discussions

Elastic Container Service, Dynamic scheduling using partitionable slots, Single processing, as well as whole-machine scheduling, etc.

Speakers: Jamie Kinney, Mario Girone (Universita del Sannio (IT)), Sanjay Padhi (Univ. of California San Diego (US))

Slides 06_-_Meet_Lambda.pdf