Walk to VSPA conference center Meet Kristina at the hotel reception at 9:15 to go to the VSPA conference center together

Announcements

Opening Ceremony

• Alberto Pace (CERN)

10.00 – 10.03: Tartu University Professor of materials technology Mrs Veronika Zadin (3 min) 10.03 – 10.10: Rector of University of Tartu prof. Toomas Asser 10.10 – 10.15: Minister of Education and Science Mrs Kristina Kallas 10.15 – 10.20: Deputy Mayor of Tartu Mr Mihkel Lees 10.20 – 10.30: CERN Director of R&D prof. Joachim Mnich 10.30 – 10.40: CERN School of Computing director, Mr Alberto Pace

Introduction to Physics Computing L1: Hadron Collider Physics

• Arnulf Quadt (Georg August Universitaet Goettingen (DE))

Here we will focus on the physics of particle collisions, theoretical aspects of the standard model of particle physics, its predictive power as well as its shortcomings. Experimental aspects such as collider facilities and modern particle physics experiments as well as example physics questions and corresponding data analyses will be discussed. Furthermore, the compute models with the resulting amount of recorded data and simulated Monte Carlo events will be described.

Tools and Techniques L1: Introduction

• Pere Mato Vila (CERN)

First, we discuss some of the characteristics of software projects for high energy physics, and some of the issues that arise when people want to contribute to them. We then continue with a brief introduction to software engineering from the perspective of the individual contributor, both as a formal process and how it actually affects what you do. We discuss the examples of unit testing and memory access problems.

Walk to DELTA building

Tools and Techniques L2: Tools for Collaboration, Software Engineering Across the Project

• Pere Mato Vila (CERN)

We continue the track with a discussion of system performance, and what you can (and can't) to affect it. We examine tools to help with that, discussing how they work and how they can mislead. We then discuss source control as a tool for collaboration. Using examples from basic to large and advanced, we show how individual choices can affect the building of large systems.

Exercise 1: Tools and Techniques

• Pere Mato Vila (CERN)

The exercises provide some direct experience with the tools and techniques described in the Lectures. Teams of two students will work together on examples designed to show the strengths and weaknesses of various tools and approaches. Basic and advanced exercises are available so that students can work at their own level. The very first step is find somebody to work with and sit down together. The two of you will be working together on these exercises. These have been designed to work best two people (or occasionally three), not with one! To start the exercises, open the instructions URL (below) in your favorite web browser and follow those instructions. Please read that index page’s instructions all the way through. We’ve put some general info at the top that you should know, and put some reference links at the bottom that you might later discover you need.

ㅤExercise 2: Tools and Techniques

• Pere Mato Vila (CERN)

This is a continuation of the Tools and Techniques exercises

Self-presentation: 1 minute per person

Introduction to Physics Computing L2: Digital Data, Simulation and Reconstruction in Modern Particle Physics Experiments

• Arnulf Quadt (Georg August Universitaet Goettingen (DE))

Here, a focus will be placed on specific detector sub-components and their data readout concepts as well as data reconstruction techniques, simulation techniques and analysis techniques.

Data Science L1: Tools for interactive data exploration

• Pere Mato Vila (CERN)

High energy physics has a rich history of interactive exploration of physics data, starting with tools like PAW and ROOT. The explosion of Data Science has created new tools for interactive exploration of large and ad-hoc datasets. This lecture introduces some of these, and shows how they can be used to find new and useful features starting with available data.

Announcements

Data Science L2: Interactive exploration of non-numeric data

• Pere Mato Vila (CERN)

This lecture continues the exploration of interactive tools, using a learn-by-doing approach. It covers approaches for statistical simulation, geographical analysis, and textual data.

Exercise 3: Tools and Techniques

• Pere Mato Vila (CERN)

The exercises provide some direct experience with the tools and techniques described in the Lectures. Teams of two students will work together on examples designed to show the strengths and weaknesses of various tools and approaches. Basic and advanced exercises are available so that students can work at their own level.

Study or sports time

Exercises 1: Data Science

• Pere Mato Vila (CERN)

The exercises provide hands-on experience in three phases: First, we reiterate some examples from lecture to give basic experience. A set of intermediate exercises then extends that to some new problem areas. Finally, students can choose of one of several larger advanced problems to work through. The very first step is find somebody to work with and sit down together. The two of you will be working together on these exercises. These have been designed to work best wo people (or occasionally three), not with one! To start the exercises, open the instructions URL (below) in your favorite web browser and follow those instructions. Please read that index page’s instructions all the way through. We’ve put some general info at the top that you should know, and put some reference links at the bottom that you might later discover you need.

Exercises 2: Data Science

• Pere Mato Vila (CERN)

The exercises provide hands-on experience in three phases: First, we reiterate some examples from lecture to give basic experience. A set of intermediate exercises then extends that to some new problem areas. Finally, students can choose of one of several larger advanced problems to work through.

Software Design L1: Parallelism in a Modern HEP Data Processing Framework

• Stephan Hageboeck (CERN)

Even though the miniaturization of transistors on chips continues like predicted by Moore's law, computer hardware starts to face scaling issues, so-called performance 'walls'. Probably, the best known is the 'power wall', which limits clock frequencies. Amongst others, a way of increasing processor performance remains now to integrate many cores in the same chip. At the same time, the upcoming LHC upgrade will increase the required CPU power drastically. Both problems challenge the current way of software design in high energy physics (HEP). Developers in high energy physics are forced to re-think their ways of software design and need to move to massively parallel applications. This lecture will explain the current HEP software design, the hardware and physics issues that need to be tackled, and possible approaches to achieve the required level of parallelization.

Software Design L2: Base Concepts of Parallel Programming: A Pragmatic Approach

• Andrei Gheata (CERN)

This and the following lecture will explain the concepts behind various parallelization methodologies. First, a theoretical introduction to threads, thread-safety and concurrent data access will be given. As the recent C++ standards (starting from C++11) provide build-in support for parallel programming, their most commonly used concurrency features will be shown. Finally, concrete solutions for problems specific to concurrent programming will be discussed.

Announcements

Data Management L1: Setting the scene: Storage technologies, Storage reliability

• Alberto Pace (CERN)

The lecture presents the various Storage Models, and the supporting management techniques. The lecture will then go in details on techniques to deliver arbitrary reliability and performance and discuss the solutions for long data preservation and trading between reliability, performances and costs.

Software Design L3: Understanding, Debugging and Profiling a Complex Multithreaded Application

• Andrei Gheata (CERN)

Dealing with a parallel application is complex. We need to use procedures to rise fences to protect against mistakes, like static analysis tools allowing to find bugs in an automatic way. We also need to use tools to inspect and manipulate the behavior of programs at runtime, like the GDB debugger. Finally, profilers such as igprof can help us understand the performance bottlenecks of an application and get more insight on its efficiency. The objective of this lecture is to become familiar with these tools and be able to apply them in multithreaded programs.

Study or sports time

Exercises 1: Software Design

• Andrei Gheata (CERN)
• Stephan Hageboeck (CERN)

The exercises will cover the topics of lectures 1 to 4 at a hands-on basis, based on C++11, TBB and Spark. It covers examples for the new C++11 functionality related to threads and thread safety. In addition, there will be examples for concurrent access to data, lock and lock-free data structures, and task based programming.  Finally, there will be an exercise to practise the Map-Reduce pattern by using the Spark parallel data processing framework.

Exercises 2: Software Design

• Stephan Hageboeck (CERN)
• Andrei Gheata (CERN)

The exercises will cover the topics of lectures 1 to 4 at a hands-on basis, based on C++11, TBB and Spark. It covers examples for the new C++11 functionality related to threads and thread safety. In addition, there will be examples for concurrent access to data, lock and lock-free data structures, and task based programming.  Finally, there will be an exercise to practise the Map-Reduce pattern by using the Spark parallel data processing framework.

The history of Estonia and current situation

• Arnulf Quadt (Georg August Universitaet Goettingen (DE))

Data Management L2: Cryptography, authentication, authorization and accounting 1

• Alberto Pace (CERN)

This lectures give elements of computer security that are relevant to data management. The lectures address the various cryptographic technologies used in data storage systems to ensure data encryption, integrity, confidentiality and access control. The Public Key infrastructure standard will be described as an example.

Software Design L4: Patterns for Parallel Software Development

• Stephan Hageboeck (CERN)

This lecture will present a set of common patterns in parallel programming. The sequential origin of these patterns will be discussed, as well as the restrictions that they impose. A particularly successful combination of patterns, Map-Reduce, will be described in detail and examples of its everyday use at large scale will be given. On the other hand, it will be shown how high-level features like C++ lambdas, the TBB library or the Spark framework can help get started with the aforementioned parallel patterns.

Announcements

Data Management L3: Cryptography, authentication, authorization and accounting 2

• Alberto Pace (CERN)

This lecture will continue the discussion on various authentication technologies and then move to authorization. Accounting will also be addressed.

Data Management L4: Distributed Hash Tables, Data Replication, Caching, Monitoring, Alarms and Quota 1

• Alberto Pace (CERN)

This lecture describes the various possible technologies used to implement distributed hash tables, data workflows and complex data transfer processes. It also discusses problems with data caching and Garbage Collection to conclude on monitoring and quota enforcement.

School photo

Data Management L5: Distributed Hash Tables, Data Replication, Caching, Monitoring, Alarms and Quota 2

• Alberto Pace (CERN)

This lecture concludes the description of the various possible technologies used to implement distributed hash tables, data workflows and complex data transfer processes. It also discusses problems with data caching and Garbage Collection to conclude on monitoring and quota enforcement.

Data Visualization L1: The Theory Behind Data Visualization

• Eamonn Maguire

In this lecture, we introduce the basic concepts behind data visualization, what we are visualizing, why we are visualizing it, and how we can visualize data more effectively.

Announcements

Data Visualization L2: Practical Applications of Theory and Multi-Dimensional Data Visualization

• Eamonn Maguire

In this lecture we apply some of what we learned in Lecture 1 and also introduce the visualization of multi-dimensional data.

ㅤExercise 3: Software Design

• Stephan Hageboeck (CERN)
• Andrei Gheata (CERN)

This is a continuation of the Software Design exercises.

Study or sports time

Exercise 1: Data Visualization

• Eamonn Maguire

Exercise 2: Data Visualization

• Eamonn Maguire

Data Technologies: Introduction

• Andreas Joachim Peters (CERN)
• Alberto Pace (CERN)

The lecture will introduce the basic concepts of IO systems, protocols and data storage models as a preparation to the data technology exercises.

Student Lightning Talks

Announcements

Data Technologies - exercises

• Andreas Joachim Peters (CERN)
• Alberto Pace (CERN)

The first part of hands-on exercises aims to improve understanding of basic parameters in IO systems: • network and media latency • access patterns • OS caching • bottlenecks and optimization strategies for local and remote data access. Few essential Linux tools will be introduced to monitor and measure IO performance avoiding bias introduced by OS caching. Students will experience and measure the impact of latency and access patterns on IO performance. The second part covers the concept of parallelism and redundancy in storage system. We will apply the technology of Cloud storage systems to store and retrieve files in our local desktop cluster using a distributed hash table to locate files or file fragments and a REST interface to do GET, PUT or DELETE operations on these. The exercises conclude with the implementation and performance tuning of a RAID verification algorithm.

Data Technologies - exercises

• Andreas Joachim Peters (CERN)

The first part of hands-on exercises aims to improve understanding of basic parameters in IO systems: • network and media latency • access patterns • OS caching • bottlenecks and optimization strategies for local and remote data access. Few essential Linux tools will be introduced to monitor and measure IO performance avoiding bias introduced by OS caching. Students will experience and measure the impact of latency and access patterns on IO performance. The second part covers the concept of parallelism and redundancy in storage system. We will apply the technology of Cloud storage systems to store and retrieve files in our local desktop cluster using a distributed hash table to locate files or file fragments and a REST interface to do GET, PUT or DELETE operations on these. The exercises conclude with the implementation and performance tuning of a RAID verification algorithm.

Visit to the Estonia National Museum (optional) Do not miss the Estonian National Museum! https://erm.ee/en The Estonian National Museum was founded in Tartu in 1909 on the initiative and with the support of the nation – with the task to protect and develop the history and culture of Estonia. As in many other European countries, primary importance was attached to preserving the old, fading peasant culture. Also considered essential was gathering and looking after artefacts contributing to better understanding of cultural development, archaeological findings, old coins, books, manuscripts and historical records. Over time, a number of other museums, archives and libraries were founded, and the Estonian National Museum re-focused mainly on folk culture. Until World War II, the Estonian National Museum accumulated everything related to the Estonian national heritage. The fact that the museum had become a recognised memory institution by the 1930s was greatly supported also by contacts with foreign countries (Finland, Sweden, Germany, France etc), both in exchanging scientific literature, participating in study and research trips and scientific conferences and also through organising exhibitions outside Estonia. Today, Estonian National Museum preserves the feeling of continuity and tradition. The museum is the generator and developer of cultural dialogue which links the past and the future. ENM`s role as a centre of ethnological research is to record, study and interpret culture as a way of life, taking into account its periodical, spatial and social diversity. The Museum's function as a contemporary cultural and tourist centre is to show our culture`s uniqueness and primeval power of creation to every Estonian and visitor. The main emphasis of research and collecting is on Estonian everyday life in the second half of the 20th century as well as on the Estonian diaspora and audiovisual, archival and artifactual data from Finno-Ugric cultures. Through the Museum’s exhibitions and events, one can take a look at Estonians’ everyday lives in different periods. Interactive displays offer hands-on experience; it is possible to observe what an Estonian home looks like, explore Estonian cuisine and make oneself familiar with local dress, language and customs. Attention is also paid to the cultures of other nations, especially those of the Finno-Ugric peoples.

Meeting in front of the hotel, entering buses

Data Analysis L1: Introduction

• Toni Sculac (University of Split Faculty of Science (HR))

In this lecture we will explain what are the main goals of data analysis. We will introduce statistics as the powerful mathematical tool for data analysis. We will define probability and random variables as key concepts in statistics for data analysis.

Data Analysis L2: Probability density functions and Monte Carlo methods

• Toni Sculac (University of Split Faculty of Science (HR))

In this lecture we will discuss what probability density functions (PDFs) are, and what are their main properties. We will mention the most important PDFs and their properties both for discrete and continuous random variables. The importance of the Gaussian distribution lies in the Central Limit Theorem that will be discussed. Finally, we will discuss the concept of Monte Carlo methods and their usage in High Energy Physics and Data Analysis.

Announcements

Data Analysis L3: Parameter estimation and confidence intervals

• Toni Sculac (University of Split Faculty of Science (HR))

In this lecture we will introduce the concept of test statistics and estimators. We will explain what are the key properties of a good estimator and how to obtain it using the Maximum Likelihood and Least Squares methods. We will define confidence intervals and make a strong statement on their statistical interpretation when discussing scientific results. Finally, we will learn how to derive confidence intervals for the Maximum likelihood and Least Squares methods.

Estonia E-Data

• Kristo Vaher (Ministry of Economic Affairs and Communications)

Study or sports time

Exercises 2: Data Technologies

• Andreas Joachim Peters (CERN)

This is a continuation of the Data Technologies exercises.

Exercises 3: Data Technologies

• Andreas Joachim Peters (CERN)

This is a continuation of the Data Technologies exercises.

Special evening talk: When Internet history meets philosophy

• Francois Fluckiger

Room: 1037

Machine Learning L1

• Lukas Alexander Heinrich (Technische Universitat Munchen (DE))

Software Security L1: Introduction

• Sebastian Lopienski (CERN)

The first lecture starts with a definition of computer security and an explanation of why it is so difficult to achieve. The lecture highlights the importance of proper threat modelling and risk assessment. It then presents three complementary methods of mitigating threats: protection, detection, reaction; and tries to prove that security through obscurity is not a good choice.

Announcements

Machine Learning L2

• Lukas Alexander Heinrich (Technische Universitat Munchen (DE))

Software Security L2: Security in different phases of software development

• Sebastian Lopienski (CERN)

The second lecture addresses the following question: how to create secure software? It introduces the main security principles (like least privilege, or defense in depth) and discusses security in different phases of the software development cycle. The emphasis is put on the implementation part: most common pitfalls and security bugs are listed, followed by advice on best practice for security development.

Study or sports time

Exercises 1: Software Security

• Sebastian Lopienski (CERN)

In the practice session, a range of typical security vulnerabilities will be presented. The goal is to learn how they can be exploited (for privilege escalation, data confidentiality compromise etc.), how to correct them, and how to avoid them in the first place! Students will be given small pieces of source code in different programming languages, and will be asked to find vulnerabilities and fix them. The online course documentation will gradually reveal more and more information to help students in this task. Additionally, students will have a chance to try several source code analysis tools, and see how such tools can help them find functionality bugs and security vulnerabilities.

Exercises 2: Software Security

• Sebastian Lopienski (CERN)

In the practice session, a range of typical security vulnerabilities will be presented. The goal is to learn how they can be exploited (for privilege escalation, data confidentiality compromise etc.), how to correct them, and how to avoid them in the first place! Students will be given small pieces of source code in different programming languages, and will be asked to find vulnerabilities and fix them. The online course documentation will gradually reveal more and more information to help students in this task. Additionally, students will have a chance to try several source code analysis tools, and see how such tools can help them find functionality bugs and security vulnerabilities.

Machine Learning L3

• Lukas Alexander Heinrich (Technische Universitat Munchen (DE))

Data Analysis L4: Hypothesis testing and p-value

• Toni Sculac (University of Split Faculty of Science (HR))

We will learn about the hypothesis testing procedure and all of its key concepts. We will discuss how to choose a critical region and learn about errors of first and second kind. We will learn the importance of a blinded analysis and understand all the needed steps before looking at the data. Finally, we will discuss when can we announce a discovery in science and the concept of a p-value.

Announcements

Exercises 1: Data Analysis

• Toni Sculac (University of Split Faculty of Science (HR))

There will be 3 sets of exercises covering basic properties of PDFs and Monte Carlo generators, Maximum Likelihood fit, and Hypothesis testing. Students will be given realistic but simplified problems where key concepts from statistics need to be applied in order to provide scientific interpretation of data. Each set of exercises consists of 5 problems that will help guide the student. Data is provided in a simple text file and can be analysed with any programming language that offers libraries for statistical analysis (Python or C++ are recommended).

Exercises 2: Data Analysis

• Toni Sculac (University of Split Faculty of Science (HR))

There will be 3 sets of exercises covering basic properties of PDFs and Monte Carlo generators, Maximum Likelihood fit, and Hypothesis testing. Students will be given realistic but simplified problems where key concepts from statistics need to be applied in order to provide scientific interpretation of data. Each set of exercises consists of 5 problems that will help guide the student. Data is provided in a simple text file and can be analysed with any programming language that offers libraries for statistical analysis (Python or C++ are recommended).

Study or sports time

Exercise 3: Software Security

• Sebastian Lopienski (CERN)

In the practice session, a range of typical security vulnerabilities will be presented. The goal is to learn how they can be exploited (for privilege escalation, data confidentiality compromise etc.), how to correct them, and how to avoid them in the first place! Students will be given small pieces of source code in different programming languages, and will be asked to find vulnerabilities and fix them. The online course documentation will gradually reveal more and more information to help students in this task. Additionally, students will have a chance to try several source code analysis tools, and see how such tools can help them find functionality bugs and security vulnerabilities.

ㅤExercise 1: Machine Learning

• Lukas Alexander Heinrich (Technische Universitat Munchen (DE))

Software Security L3: Web application security, exercise debriefing

• Sebastian Lopienski (CERN)

This third hour consists of a debriefing of the exercises, and in particular those web-related. Various vulnerabilities typical to web applications (such as Cross-site scripting, SQL injection, cross-site request forgery etc.) are introduced and discussed.

Announcements

ㅤExercise 3: Data Analysis

• Toni Sculac (University of Split Faculty of Science (HR))

This is a continuation of the Data Analysis exercises

Exercises 2: Machine Learning

• Lukas Alexander Heinrich (Technische Universitat Munchen (DE))

Exercises 3: Machine Learning

• Lukas Alexander Heinrich (Technische Universitat Munchen (DE))

Exam In order to see results please login with you CERN account (the one used during exercises)

The CSC Traditional football match

Student Lightning talks

Announcements

Transport to visits

Visits to GSCAN/Tartu Observatory Field trip to GScan GScan is a company near Tartu that is redefining the boundaries of 3D scanning with Muon Flux Technology (MFT) detectors. GScan is using naturally occurring cosmic-ray induced muons, electrons and positrons as the source for performing 3D scanning and chemical composition analysis. Utilising a natural source makes every GScan system radiation safe - no harm to the surrounding people nor the environment itself. Their solutions are modular and highly-scalable, using the in-house developed 1m x 2m detector array modules. With a strong base of startup mindset, fundamental and information sciences, a highly modern manufacturing industry, coupled with high work ethics coming from Estonia has provided us with a strong competitive edge for developing such a complex technology. Field trip to Tartu Observatory Tartu Observatory is an Estonian space centre whose main task is research and development. They train young scientists in astronomy, remote sensing, and space technology, and are a recognised partner in international networks. Tartu Observatory has accredited test laboratories where companies can test their equipment in different environmental conditions. The laboratory complex of the observatory offers environmental testing of devices and optical measurements. The laboratories include special electrostatic discharge (ESD) safe areas, a cleanroom and an anechoic environment. Tartu Observatory´s history goes back to the 19th century when the Tartu Old Observatory (Tartu Tähetorn) was built. There, astronomer F. G. W. Struve created the meridian arc to determine the shape and size of the globe, this geodetic arc is listed under UNESCO World Heritage. In the mid 20th century scientists led by Einasto discovered the honeycomb-like structure of the universe. We`ll visit the laboratories, have mini lecture about data gathering and science in soviet times and of course visit the big telescope (1.5 m mirror telescope AZT-12 with a long-slit spectograph in the Cassegrain focus, providing spectral resolution of R~ 100 to 12000).

Transport to Delta building

Graduation and closing ceremony