CERN School of Computing 2017

Aug 27, 2017, 11:00 AM → Sep 9, 2017, 6:00 PM Europe/Zurich

Universidad Politécnica de Madrid

Cath Noble (CERN), Nikos Kasioumis (CERN), Sebastian Lopienski (CERN)

Welcome to the CERN School of Computing, which this year takes us to the world-class city of Madrid in Spain.

The programme

We have an indepth programme of advanced, interesting and challenging computing topics planned, which will provide ECTS university credits upon successful completion of the CSC exam.

CSC 2017 will provide around 52 hours of lectures and hands-on exercises. The hands-on component includes projects and mini-challenges carried out in small groups and as individuals.

We will be covering the broad domain of data storage and management technologies, fundamental concepts of Physics Computing, and cover many complementary topics such as software engineering, computer architecture, computing security and networking. See the Programme for more details.

Other activities

However it's not all study; the social and sporting programme is also a vital part of the School. Madrid is famous for its festivals, culture and cuisine, and along with your new friends and colleagues at the CSC 2017, there will ample opportunities to explore and experience the local area.

Who can apply?

The CSC 2017 school is aimed at postgraduate (ie. minimum of Bachelor degree or equivalent) engineers or scientists, working at CERN or at other research institutes, with experience in particle physics, in computing or in related fields. We welcome applications from all nationalities.

CSC 2017 is organised in collaboration with the Universidad Politécnica de Madrid.

Important dates

• Wednesday 10 May (midnight CET/GMT+1) - deadline for applications
• By Friday 2 June - you will be informed of outcome of selections
• Monday 19 June - latest date for School fees payment if you are accepted.
• Sunday 27 August - afternoon/evening - student arrivals at Residencia Galdos, Madrid.
• Saturday 9 September - morning - departure.

       

CSC2017-booklet-final.pdf

CSC-2017-Introduction.pdf

CSC2017 Poster

CSC2017 Virtual Machine MD5 checksum Virtual Machine (~2.4GB)

Sunday, August 27

3:00 PM Registration - welcome

For all participants of the CSC 2017

7:00 PM BBQ dinner

Monday, August 28

Opening Ceremony

Convener: JoséMiguel Atienza (Vice-Rector for Academic Strategies and Internationalization, Universidad Politécnica de Madrid (UPM))

CSC 2017 Opening Ceremony programme.pdf

1 Opening address

Speaker: Carmen Vela Olmo (Spanish State Secretary of Science, Development and Innovation)

2 Physics at the LHC and beyond

Speaker: Eckhard Elsen (CERN)

3 Some computing challenges for next generation LHC physics

Speaker: Frederic Hemmer (CERN)

4 CERN School of Computing

Speaker: Sebastian Lopienski (CERN)

2017 CSC - Opening Ceremony.pdf

2017 CSC - Opening Ceremony.pptx

5 Physics and computing: a two-way research street

Speaker: Javier Soriano (Director of Escuela Técnica Superior de Ingenieros Informáticos (ETSIINF), Universidad Politecnica de Madrid (UPM))

6 UPM at a glance

Speaker: José Miguel Atienza (Vice-Rector for Academic Strategies and Internationalization, Universidad Politécnica de Madrid (UPM))

7 Spain at the LHC: Past, Present and Future

Speaker: Mario Martinez-Perez (Head of Experimental Division, Institut de Fisica d'Altes Energies (IFAE), The Barcelona Institute of Science and Technology (BIST))

11:00 AM Welcome Coffee

8 Introduction to Physics Computing L1: Hadron Collider Physics

Here we will focus on the physics of particle collisions, theoretical aspects of the standard model of particle physics, its predictive power as well as its shortcomings. Experimental aspects such as collider facilities and modern particle physics experiments as well as example physics questions and corresponding data analyses will be discussed. Furthermore, the compute models with the resulting amount of recorded data and simulated Monte Carlo events will be described.

Speaker: Arnulf Quadt (University of Göttingen)

L1 - CSC_Lectures-AQuadt_09072017.pdf

12:30 PM Bus to UPM

1:00 PM Lunch

9 Tools and Techniques L1: Introduction

To start, we discuss some of the characteristics of software projects for high energy physics, and some of the issues that arise when people want to contribute to them. This forms the framework for the Software Technologies Track. We then continue with a brief introduction to software engineering from the perspective of the individual contributor, both as a formal process and how it actually affects what you do. The lecture discusses several categories of tools & techniques you can use to make yourself more productive and effective. Continuous testing and documentation has proven to be important in producing high quality work, but it's often difficult to do; we discuss some available approaches. Many problems require specific tools and techniques to solve them effectively: We discuss the examples of performance tuning and memory access problems.

Speaker: Bob Jacobsen (LBNL)

Jacobsen-Lecture1.pdf

10 Tools and Techniques L2: Tools for Collaboration, Software Engineering Across the Project

HEP software is built by huge teams. How can this be done effectively, while still giving people satisfying tasks to perform? Large systems are a hard problem, and this lecture focuses on the current techniques for dealing with it. Use of central source control (e.g. SVN) has become routine, so we build on that understanding to discuss distributed systems like Git. We then discuss the larger area of release & distributing via a package versioning system (e.g. SVN and CMT) vs. a distributed build system (e.g. Git and CMake). Now that we've covered both individual and group work, we go back to the software engineering topics of the first lecture to see how these fit together. How does our individual work affect the ability of the entire project to proceed? What are tools and techniques that will improve both our individual work, and out contributions to the whole? We close with a summary of observations.

Speaker: Bob Jacobsen (LBNL)

Jacobsen-Lecture2.pdf

11 Updates

Updates-0828-Mon.pdf

4:15 PM Afternoon break

12 Tools and Techniques E1

The first three exercises provide some direct experience with the tools and techniques described in Lectures 1 and 2. Teams of two students will work together on through examples designed to show the strengths and weaknesses of various tools and approaches. This will be followed by small projects for additional development experience.

Speaker: Bob Jacobsen (LBNL)

Indico.md

13 Tools and Techniques E2

The first three exercises provide some direct experience with the tools and techniques described in Lectures 1 and 2. Teams of two students will work together on through examples designed to show the strengths and weaknesses of various tools and approaches. This will be followed by small projects for additional development experience.

Speaker: Bob Jacobsen (LBNL)

7:00 PM Bus to Galdos

8:00 PM Bus

8:15 PM Welcome Cocktail & Dinner

11:00 PM Bus to Galdos

Tuesday, August 29

8:15 AM Bus to UPM

14 Introduction to Physics Computing L2: Digital Data, Simulation and Reconstruction in Modern Particle Physics Experiments

Here, a focus will be placed on specific detector sub-components and their data readout concepts as well as data reconstruction techniques, simulation techniques and analysis techniques.

Speaker: Arnulf Quadt (University of Göttingen)

L2 - CSC_Lectures-AQuadt_09072017.pdf

15 Updates

Updates-0829-Tue.pdf

10:15 AM Morning break

16 Software Security L1: Introduction

First lecture starts with a definition of computer security and an explanation of why it is so difficult to achieve. The lecture highlights the importance of proper threat modelling and risk assessment. It then presents three complementary methods of mitigating threats: protection, detection, reaction; and tries to prove that security through obscurity is not a good choice.

Speaker: Sebastian Lopienski (CERN)

L1 -CSC2017-Lopienski-CreatingSecureSoftware-handouts.pdf

17 Computer Architecture & Performance Tuning L1: Hardware vs. software vs. you – who’s the boss?

Considering the rise of complex many-core processors, a sufficient understanding of their architecture and of the applicable performance tuning opportunities has become an indispensable element of software development.

In this lecture, the anatomy of a modern PC (x86) server is discussed, with a particular focus on the CPU. Multiple resources and strategies to achieve optimal performance exist, both in hardware and in software – but how to take control of them?

Non-x86 architectures of growing importance, such as ARM and NVIDIA, will also be briefly covered. The lecture will be supported by relevant examples from the physics domain.

Speaker: Andrzej Nowak

1:00 PM Lunch

18 Tools and Techniques E3

The first three exercises provide some direct experience with the tools and techniques described in Lectures 1 and 2. Teams of two students will work together on through examples designed to show the strengths and weaknesses of various tools and approaches. This will be followed by small projects for additional development experience.

Speaker: Bob Jacobsen (LBNL)

19 Tools and Techniques E4

After the two-person teams acquire some experience with the development and release tools, we will group projects to demonstrate some of the real-world issues discussed in the lecture. Groups of two teams will first work together to create a functional release from individual sub-projects at various stages of completion to show the strengths and weaknesses of test and release tools. This is followed by a larger scale exercise with groups of teams.

Speaker: Bob Jacobsen (LBNL)

4:00 PM Afternoon break

20 Tools and Techniques E5

After the two-person teams acquire some experience with the development and release tools, we will group projects to demonstrate some of the real-world issues discussed in the lecture. Groups of two teams will first work together to create a functional release from individual sub-projects at various stages of completion to show the strengths and weaknesses of test and release tools. This is followed by a larger scale exercise with groups of teams.

Speaker: Bob Jacobsen (LBNL)

5:30 PM Bus to Boadilla

5:45 PM Study time / daily sports (Boadilla)

7:30 PM Bus to Galdos

8:15 PM Dinner

9:30 PM Pub quiz night

Wednesday, August 30

8:15 AM Bus to UPM

21 Data Technologies L1: Setting the scene: Storage technologies

The lecture presents the various Storage Models, and the supporting management techniques including Name Servers and interfaces for Data Management.

Storage Reliability and performance
The lecture will also discuss the various solution to ensure long data preservation and reliability with the consequences on performance, including when using Peer to Peer Storage and data transfers.

Speaker: Alberto Pace (CERN)

22 Updates

Updates-0830-Wed.pdf

10:15 AM Morning break

23 Computer Architecture & Performance Tuning L2: Architectural Details and Performance Studies

Although by using various tools we are often able to get a generous peek both inside hardware and software, drawing meaningful high-level conclusions is not always straightforward. More challenges come from accelerators and co-processors, where different computing paradigms take precedence, such as extreme data parallelism, different math capabilities, the importance of special languages as well as memory size and topology changes. The objective of this lecture is to bring the audience closer to "where it matters" in modern computing systems, and to identify important paths for high performance.

Speaker: Andrzej Nowak

24 Software Security L2: Security in different phases of software development

The second lecture addresses the following question: how to create secure software? It introduces the main security principles (like least-privilege, or defense-in-depth) and discusses security in different phases of the software development cycle. The emphasis is put on the implementation part: most common pitfalls and security bugs are listed, followed by advice on best practice for security development.

Speaker: Sebastian Lopienski (CERN)

L2 - CSC2017-Lopienski-CreatingSecureSoftware-handouts.pdf

1:00 PM Lunch

25 Software Security E1

In the practice session, a range of typical security vulnerabilities will be presented. The goal is to learn how they can be exploited (for privilege escalation, data confidentiality compromise etc.), how to correct them, and how to avoid them in the first place! Students will be given small pieces of source code in different programming languages, and will be asked to find vulnerabilities and fix them. The online course documentation will gradually reveal more and more information to help students in this task. Additionally, students will have a chance to try several source code analysis tools, and see how such tools can help them find functionality bugs and security vulnerabilities.

Speaker: Sebastian Lopienski (CERN)

26 Software Security E2

In the practice session, a range of typical security vulnerabilities will be presented. The goal is to learn how they can be exploited (for privilege escalation, data confidentiality compromise etc.), how to correct them, and how to avoid them in the first place! Students will be given small pieces of source code in different programming languages, and will be asked to find vulnerabilities and fix them. The online course documentation will gradually reveal more and more information to help students in this task. Additionally, students will have a chance to try several source code analysis tools, and see how such tools can help them find functionality bugs and security vulnerabilities.

Speaker: Sebastian Lopienski (CERN)

4:00 PM Afternoon break

27 Software Security E3

In the practice session, a range of typical security vulnerabilities will be presented. The goal is to learn how they can be exploited (for privilege escalation, data confidentiality compromise etc.), how to correct them, and how to avoid them in the first place! Students will be given small pieces of source code in different programming languages, and will be asked to find vulnerabilities and fix them. The online course documentation will gradually reveal more and more information to help students in this task. Additionally, students will have a chance to try several source code analysis tools, and see how such tools can help them find functionality bugs and security vulnerabilities.

Speaker: Sebastian Lopienski (CERN)

5:30 PM Bus to Madrid

6:00 PM Old Madrid guided visit

8:00 PM Bus to Galdós

8:15 PM Dinner

Thursday, August 31

8:15 AM Bus to UPM

28 Data Technologies L2: Cryptography, authentication authorization and accounting 1

These lectures give elements of computer security that are relevant to data management. The lectures address the various technologies used in data storage systems to ensure data encryption, integrity, confidentiality and access control

Speaker: Alberto Pace (CERN)

29 Updates

Updates-0831-Thu.pdf

10:15 AM Morning break

30 Data Technologies L3: Cryptography, authentication authorization and accounting 2

These lectures give elements of computer security that are relevant to data management. The lectures address the various technologies used in data storage systems to ensure data encryption, integrity, confidentiality and access control.

Speaker: Alberto Pace (CERN)

31 Software Design L1: Physics and Computing Challenges to Experiment Software

Even though the miniaturization of transistors on chips continues like predicted by Moore's law, computer hardware starts to face scaling issues, so-called performance 'walls'. Probably, the best known is the 'power wall', which limits clock frequencies. Amongst others, a way of increasing processor performance remains now to integrate many cores in the same chip. At the same time, the upcoming LHC upgrade will increase the required CPU power drastically. Both problems challenge the current way of software design in high energy physics (HEP). Developers in high energy physics are forced to re-think their ways of software design and need to move to massively parallel applications. This lecture will explain the current HEP software design, the hardware and physics issues that need to be tackled, and possible approaches to achieve the required level of parallelization.

Speaker: Enric Tejedor (CERN)

L1 - CSC2017_PiparoTejedor.pdf

1:00 PM Lunch

1:45 PM Bus

3:00 PM Special Sports afternoon

Selection of sports with YUCALCARI at Virgen De La Nueva.
Dinner at Restaurant Virgen de la Nueva

9:30 PM Bus to Galdos

Friday, September 1

8:15 AM Bus to UPM

32 Data Technologies L4: Additional component for Data Replication, Caching, Monitoring, Alarms and Quota 1

This lecture describes the various possible technologies used to implement data workflows and complex data transfer processes. It also discusses problems with data caching and Garbage Collection to conclude on monitoring and quota enforcement.

Speaker: Alberto Pace (CERN)

33 Updates

Updates-0901-Fri.pdf

10:15 AM Morning break

34 Data Technologies L5: Additional component for Data Replication, Caching, Monitoring, Alarms and Quota 2

This lecture describes the various possible technologies used to implement data workflows and complex data transfer processes. It also discusses problems with data caching and Garbage Collection to conclude on monitoring and quota enforcement.

Speaker: Alberto Pace (CERN)

35 Software Design L2: Concurrent Programming in Action 1

This and the following lecture will explain the concepts behind various parallelization methodologies.
First, a theoretical introduction into threads, thread-safety and concurrent data access will be given. As the new C++ standard (C++11) now provides build-in support for parallel programming, the new features of this standard will be shown. Finally, concrete solutions for the theoretical problems will be discussed.

Speaker: Danilo Piparo (CERN)

L2 - CSC2017_PiparoTejedor.pdf

1:00 PM Lunch

36 Computer Architecture & Performance Tuning E1

The aim of the exercises in this series is to give the attendees a practical introduction to performance oriented programming on Linux. Advanced tools will be used during the course, enabling the participants to discover how the interaction of the code and the hardware influences performance. The participants will also be given the task of correlating performance figures with certain programming decisions. In addition, the participants will understand the limits of performance optimization and the ways to establish at which point inside those limits their workload is placed. The exercises will be supported by demonstrating real world problems in production environments, including multi-threaded examples.

Speaker: Andrzej Nowak

37 Computer Architecture & Performance Tuning E2

The aim of the exercises in this series is to give the attendees a practical introduction to performance oriented programming on Linux. Advanced tools will be used during the course, enabling the participants to discover how the interaction of the code and the hardware influences performance. The participants will also be given the task of correlating performance figures with certain programming decisions. In addition, the participants will understand the limits of performance optimization and the ways to establish at which point inside those limits their workload is placed. The exercises will be supported by demonstrating real world problems in production environments, including multi-threaded examples.

Speaker: Andrzej Nowak

4:00 PM Afternoon break

38 Computer Architecture & Performance Tuning E3

Speaker: Andrzej Nowak

5:30 PM Study time / daily sports (UPM)

7:15 PM Bus to Galdos

8:15 PM Dinner

9:00 PM Disco-time with DJ Andrzej

Saturday, September 2

39 Data Visualizations L1

Speaker: Eamonn Maguire

CSC-Visualization-Course-Pt1.pdf

40 Data Visualizations L2

Speaker: Eamonn Maguire

CSC-Visualization-Course-Pt2.pdf

41 Updates

Updates-0902-Sat.pdf

11:00 AM Morning break

42 Data Visualizations E1

Speaker: Eamonn Maguire

1:00 PM Lunch

2:00 PM Free time

8:15 PM Dinner

Sunday, September 3

8:30 AM Bus to Toledo

10:00 AM Day trip excursion

4:00 PM Free time in Toledo

5:00 PM Bus to Camping El Greco

5:15 PM Relaxation and Tapas dinner

Gardens, terrace, swimming, and tapas at 19:00

9:00 PM Bus to Galdos

Monday, September 4

8:15 AM Bus to UPM

43 Data Analysis L1: Introduction to data analysis and Monte Carlo method

First lecture in Data Analysis series discuss graphical techniques used in exploratory data analysis, gives an introduction to concept of probability, and descriptive statistics summarizing the basic features of the data gathered from experiments. Monte Carlo method is introduced and explained with examples from engineering and high energy physics.

Speaker: Ivica Puljak (FESB)

CSC2017_Lectures-Data_Analysis_IP_L1.pdf

44 Updates

Updates-0904-Mon.pdf

10:15 AM Morning break

45 Software Design L3: Concurrent Programming in Action 2

The focus of this lecture lies in concurrent programming based on the 'task model', using TBB as implementation library. There will be a deeper look into concurrent data access and lock and lock-free data formats. Using the learned concepts, we will look again at the data challenges from lecture 1 and see, how a future-proof software design might look like.

Speaker: Danilo Piparo (CERN)

L3 - CSC2017_PiparoTejedor.pdf

46 Software Design L4: Patterns for Parallel Software Development

This lecture will present a set of common patterns in parallel programming. The sequential origin of these patterns will be discussed, as well as the restrictions that they impose. A particularly successful combination of patterns, Map-Reduce, will be described in detail and examples of its everyday use at large scale will be given. On the other hand, it will be shown how high-level features like C++ lambdas, the TBB library or the Spark framework can help get started with the aforementioned parallel patterns.

Speaker: Enric Tejedor (CERN)

L4 - CSC2017_PiparoTejedor.pdf

1:00 PM Lunch

47 Software Design E1

The exercises will cover the topics of lectures 1 to 4 at a hands-on basis, based on C++11, TBB and Spark. It covers examples for the new C++11 functionality related to threads and thread safety. In addition, there will be examples for concurrent access to data, lock and lock-free data structures, and task based programming.  Finally, there will be an exercise to practise the Map-Reduce pattern by using the Spark parallel data processing framework.

Speakers: Danilo Piparo (CERN), Enric Tejedor (CERN)

48 Software Design E2

The exercises will cover the topics of lectures 1 to 4 at a hands-on basis, based on C++11, TBB and Spark. It covers examples for the new C++11 functionality related to threads and thread safety. In addition, there will be examples for concurrent access to data, lock and lock-free data structures, and task based programming.  Finally, there will be an exercise to practise the Map-Reduce pattern by using the Spark parallel data processing framework.

Speakers: Danilo Piparo (CERN), Enric Tejedor (CERN)

4:00 PM Afternoon break

49 Software Design E3

The exercises will cover the topics of lectures 1 to 4 at a hands-on basis, based on C++11, TBB and Spark. It covers examples for the new C++11 functionality related to threads and thread safety. In addition, there will be examples for concurrent access to data, lock and lock-free data structures, and task based programming.  Finally, there will be an exercise to practise the Map-Reduce pattern by using the Spark parallel data processing framework.

Speakers: Danilo Piparo (CERN), Enric Tejedor (CERN)

5:30 PM Study time / visits / daily sports (UPM)

7:15 PM Bus to Galdos

8:15 PM Dinner

Tuesday, September 5

8:15 AM Bus to UPM

50 Data Analysis L2: Distributions and estimators

In this lecture commonly used probability distributions are introduced with basic properties and few examples. Parameter estimation with maximum likelihood and least-squared methods is explained.

Speaker: Ivica Puljak (FESB)

CSC20167Lectures-Data_Analysis_IP_L2.pdf

51 Updates

Updates-0905-Tue.pdf

10:15 AM Morning break

52 Networking Performance L1: Internet Quality of Service options

This first topic discusses the status and the option to master and improve on the Quality of Service of the Internet. Indeed, modern scientific applications require fast transfers high-bit rate connections, as well as network predictability and high availability. On the other hand, the Internet historical technology is not naturally best suited to deterministic behaviour. This lecture explains the technical challenges and the range of options available to improve QoS guarantees in Internet-based networks.

Speaker: Francois Fluckiger

L1 - F.Fluckiger - Networking Performance - CSC2017.pdf

53 Data Analysis L3: Confidence intervals

Determining the errors on the parameters, which is equivalent to the confidence interval estimation is shown with specific examples on maximum likelihood and least-squared methods in one and more than one dimension. Uncertainties in physics and error propagation are also discussed.

Speaker: Ivica Puljak (FESB)

CSC2017_Lectures-Data_Analysis_IP_L3.pdf

1:00 PM Lunch

54 Data Analysis E1: Monte Carlo method and Fitting with Root

• Generating random numbers
• Monte-Carlo toy experiments
• Modeling signal and background. 
• Fitting with ROOT packages (finding peaks).

Speaker: Ivica Puljak (FESB)

55 Data Analysis E2: Confidence interval

• Finding errors on fit parameters 
• Extracting confidence intervals

Speaker: Ivica Puljak (FESB)

4:00 PM Afternoon break

56 Data Analysis E3: Hypothesis testing

• Finding p-value
• Converting p-values to significance
• Low count experiments and hypothesis testing

Speaker: Ivica Puljak (FESB)

5:30 PM Bus to Boadilla

5:45 PM Study time / daily sports (Boadilla)

7:30 PM Bus to Galdos

8:15 PM Dinner

57 Special evening talk

Speaker: Francois Fluckiger

Wednesday, September 6

8:15 AM Bus to UPM

58 Multivariate Classification L1: Traditional Techniques

The aim of this lecture is to make the audience aware of multivariate classification (MVC) methods. Commonly used classification methods are introduced and the fundamental concepts behind them are explained. In particular boosted decision trees and artificial neural networks are discussed in detail.

Speaker: Thomas Keck (KIT)

github repo - links to all papers and an extensive further reading list

L1 - MultivariateClassificationLecture.pdf

59 Updates

Updates-0906-Wed.pdf

10:15 AM Morning break

60 Multivariate Classification L2: Deep Learning

The aim of this lecture is to make the audience aware of multivariate classification (MVC) methods. Commonly used classification methods are introduced and the fundamental concepts behind them are explained. In particular boosted decision trees and artificial neural networks are discussed in detail.

Speaker: Thomas Keck (KIT)

github repo - links to all papers and an extensive further reading list

L2 - MultivariateClassificationLecture.pdf

61 Networking Performance L2: Multimedia over the Internet

The Internet is not only a network of computer resources but also a network of people cooperating to use these resources, in particular in professional scientific environment. Part of the collaborative tools scientists are increasingly using include audio and video systems. They place new challenging requirements on the networking systems. The class discusses these requirements and their consequences on the end-systems as well as within the underlying network.

Speaker: Francois Fluckiger

L2 -F.Fluckiger - Networking Performance - CSC2017.pdf

1:00 PM Lunch

1:45 PM CSC 2017 School Photo

62 Data Technologies E1

The first part of hands-on exercises aims to improve understanding of basic parameters in IO systems:
• network and media latency
• access patterns
• OS caching
• bottlenecks and optimization strategies for local and remote data access.
Few essential Linux tools will be introduced to monitor and measure IO performance avoiding bias introduced by OS caching. Students will experience and measure the impact of latency and access patterns on IO performance.
The second part covers the concept of parallelism and redundancy in storage system. We will apply the technology of Cloud storage systems to store and retrieve files in our local desktop cluster using a distributed hash table to locate files or file fragments and a REST interface to do GET, PUT or DELETE operations on these.
The exercises conclude with the implementation and performance tuning of a RAID verification algorithm.

Speaker: Andreas Peters (CERN)

63 Data Technologies E2

The first part of hands-on exercises aims to improve understanding of basic parameters in IO systems:
• network and media latency
• access patterns
• OS caching
• bottlenecks and optimization strategies for local and remote data access.
Few essential Linux tools will be introduced to monitor and measure IO performance avoiding bias introduced by OS caching. Students will experience and measure the impact of latency and access patterns on IO performance.
The second part covers the concept of parallelism and redundancy in storage system. We will apply the technology of Cloud storage systems to store and retrieve files in our local desktop cluster using a distributed hash table to locate files or file fragments and a REST interface to do GET, PUT or DELETE operations on these.
The exercises conclude with the implementation and performance tuning of a RAID verification algorithm.

Speaker: Andreas Peters (CERN)

4:00 PM Afternoon break

64 Data Technologies E3

The first part of hands-on exercises aims to improve understanding of basic parameters in IO systems:
• network and media latency
• access patterns
• OS caching
• bottlenecks and optimization strategies for local and remote data access.
Few essential Linux tools will be introduced to monitor and measure IO performance avoiding bias introduced by OS caching. Students will experience and measure the impact of latency and access patterns on IO performance.
The second part covers the concept of parallelism and redundancy in storage system. We will apply the technology of Cloud storage systems to store and retrieve files in our local desktop cluster using a distributed hash table to locate files or file fragments and a REST interface to do GET, PUT or DELETE operations on these.
The exercises conclude with the implementation and performance tuning of a RAID verification algorithm.

Speaker: Andreas Peters (CERN)

5:30 PM Bus to Galdós

6:00 PM Study/free time (Galdós)

8:15 PM Dinner

Thursday, September 7

8:15 AM Bus to UPM

65 Data Analysis L4: Statistical tests

Hypothesis testing is introduced with examples of goodness-of-fit tests and the most recent examples from high energy physics. Particular emphasis is given on the p-values and when we claim the discoveries.

Speaker: Ivica Puljak (FESB)

CSC2017_Lectures-Data_Analysis_IP_L4.pdf

66 Updates

Updates-0907-Thu.pdf

10:15 AM Morning break

67 Multivariate Classification E1

Speaker: Thomas Keck (KIT)

68 Multivariate Classification E2

Speaker: Thomas Keck (KIT)

1:00 PM Lunch

69 Data Technologies E4

The first part of hands-on exercises aims to improve understanding of basic parameters in IO systems:
• network and media latency
• access patterns
• OS caching
• bottlenecks and optimization strategies for local and remote data access.
Few essential Linux tools will be introduced to monitor and measure IO performance avoiding bias introduced by OS caching. Students will experience and measure the impact of latency and access patterns on IO performance.
The second part covers the concept of parallelism and redundancy in storage system. We will apply the technology of Cloud storage systems to store and retrieve files in our local desktop cluster using a distributed hash table to locate files or file fragments and a REST interface to do GET, PUT or DELETE operations on these.
The exercises conclude with the implementation and performance tuning of a RAID verification algorithm.

Speaker: Andreas Peters (CERN)

70 Data Technologies E5

The first part of hands-on exercises aims to improve understanding of basic parameters in IO systems:
• network and media latency
• access patterns
• OS caching
• bottlenecks and optimization strategies for local and remote data access.
Few essential Linux tools will be introduced to monitor and measure IO performance avoiding bias introduced by OS caching. Students will experience and measure the impact of latency and access patterns on IO performance.
The second part covers the concept of parallelism and redundancy in storage system. We will apply the technology of Cloud storage systems to store and retrieve files in our local desktop cluster using a distributed hash table to locate files or file fragments and a REST interface to do GET, PUT or DELETE operations on these.
The exercises conclude with the implementation and performance tuning of a RAID verification algorithm.

Speaker: Andreas Peters (CERN)

4:00 PM Afternoon break

4:30 PM CSC Examination

6:00 PM Traditional CSC football match

7:30 PM Bus to Galdos

8:15 PM Dinner

Friday, September 8

8:15 AM Bus to UPM

71 Guest lecture: Software testing and its automation

Software testing is a core activity of any project involving software development. The goal of testing is to detect as many faults as possible during the development process such that they could be fixed before deployment.

This lecture will cover some of the basic concepts of software testing and its automation: how to properly use a testing infrastructure on a continuous integration environment, how to write test cases using black and white box techniques, how to effectively maintain a test suite in a rapidly evolving project, and how to make test suites effective at catching real faults.

Speaker: Alessandra Gorla (IMDEA)

72 Updates

Updates-0908-Fri.pdf

10:15 AM Morning break

73 Guest lecture: Codes, shuffles and cards

There are a lot of card magic tricks that are based in mathematical properties. There are several tricks related to binary system of numbering but it's not the only example relating computing and magic: even there is a PhD Thesis that studied the relationship between shuffles and dynamic computer memories. Error detecting codes, divisibility properties, algorithms and Gilbreath's principle are just some examples that underlie in some magic tricks. In this talk we present some of those effects as well as the mathematics they are based on. We also give clues for the people who like a deeper knowledge on this subject.
The talk is intended as an interactive talk where attendees participate in "the show".

Speaker: Fernando Blasco (UPM)

74 Guest lecture: Space environment and space mission design

How the environment in outer space and in different extra-terrestrial bodies influences and conditions the design of space missions, with some practical examples of actual missions.

Speaker: Gustavo Alonso (UPM)

1:00 PM Lunch

75 Presentations by Students

Speakers: Alexei Sytov (Universita di Ferrara & INFN (IT)), Antoni Shtipliyski (University of Manchester (GB)), Christian Bourjau (University of Copenhagen (DK)), Davide Pedretti (Universita e INFN, Legnaro (IT)), Lennaert Bel (Nikhef National institute for subatomic physics (NL)), Marzieh Bahmani (Polish Academy of Sciences (PL)), Stefan-Gabriel Chitic (CERN), Ulf Bobson Severin Tigerstedt (Helsinki Institute of Physics (FI)), Vojtech Simetka (CERN), Wojciech Ziolek (CERN)

170908_csc_rust.pdf

Bel_csc_presentation.pptx

Chitic_Stefan_Migration_to_python3 .pdf

csc2017-studentpresentation-tigerstedt.pdf

mbahmani.pdf

Pedretti_IOC.pptx

SCOAP3 slides CSC 2017 - ziolek.pdf

Sytov_simulations1.pdf

Vojtech Simetka - Gold 2.0.pdf

3:30 PM Afternoon break

76 Graduation ceremony

Speaker: Sebastian Lopienski (CERN)

77 Closing session

CSC2017 - Photo Contest.pdf

6:00 PM Bus to Galdós

6:30 PM Free time

8:00 PM Bus

8:15 PM Closing dinner

10:00 PM After-dinner PARTY

11:30 PM Bus to Galdos

Optional - for those who want to go back

Saturday, September 9

8:15 AM Departure