Tutorial for Scientific Computing using Amazon

Monday 2 Feb 2015, 08:00 → 18:00 Europe/Zurich

30/7-018 - Kjell Johnsen Auditorium (CERN)

Maria Girone (CERN), Sanjay Padhi (Univ. of California San Diego (US))

09:10 → 09:30 Introduction to the hands-on workshop

Speakers: Dr Maria Girone (CERN), Sanjay Padhi (Univ. of California San Diego (US))

Slides spadhi_intro.pdf

09:30 → 10:20 Scientific Computing at Amazon

Speaker: Jamie Kinney (Amazon)

Slides 01_-_Scientific_Computing_at_Amazon.pdf

10:20 → 11:00 Hands-on tutorial to run basic CMS/Non-CMS related applications on EC2

Speakers: Jamie Kinney (Amazon), Sanjay Padhi (Univ. of California San Diego (US))

Slides 03_-_ECS-All-about-containers.pdf

11:00 → 11:20 Coffee break

11:20 → 12:05 Introduction to Storage, Data Transfer and Security Protocols at Amazon

Speaker: Jamie Kinney (Amazon)

Slides 02_-_Storage,_Data_Transfer_and_Security.pdf 04_-_Maximizing_Amazon_S3_Performance.pdf

12:05 → 12:30 CMS storage and security models, data transfers, PheDEX interoperability with AWS

Speaker: Dr Tony Wildish (Princeton University (US))

Slides 2015-02-02-PhEDEx-Amazon-tutorial.pdf 2015-02-02-PhEDEx-Amazon-tutorial.pptx

12:30 → 14:00 Lunch

14:00 → 14:45 CMS Distributed Analysis framework & Tutorial using Amazon resources

- User analysis workflow (CRAB) without inputs (Monte Carlo) - User analysis workflow (CRAB) with pre-staged input data

Speakers: Brian Paul Bockelman (University of Nebraska (US)), Marco Mascheroni (Universita & INFN, Milano-Bicocca (IT))

Slides CRAB3-EC2.pdf DemoAmazon.pdf

14:45 → 15:15 Introduction to both relational and non-relational databases available at Amazon

Speaker: Jamie Kinney (Amazon)

Slides 05_-_Advanced_Data_and_Analyitcs.pdf

15:15 → 15:40 Introduction to Amazon Monitoring and Auditing Systems

Speaker: Steven Bryen (Amazon)

Slides 07_-_Monitoring_101_(SB).pptx

15:40 → 16:10 Other developments related to user driven Tier-3 usage/model: OSG Connect

Speaker: Robert William Gardner Jr (University of Chicago (US))

Slides OSG_Connect_CMS-Amazon.pdf

16:10 → 16:25 Coffee break

16:25 → 16:50 Challenges in using Amazon for Scientific Computing

Speaker: Ian Fisk (Fermi National Accelerator Lab. (US))

Slides Amazon_Cloud.pdf

16:50 → 17:30 Discussions

Elastic Container Service, Dynamic scheduling using partitionable slots, Single processing, as well as whole-machine scheduling, etc.

Speakers: Jamie Kinney, Mario Girone (Universita del Sannio (IT)), Sanjay Padhi (Univ. of California San Diego (US))

Slides 06_-_Meet_Lambda.pdf