HEPiX Spring 2019 Workshop

Session

Computing & Batch Systems

27 Mar 2019, 14:00

E-B 212 (SDSC Auditorium)

24. Benchmarking Worrking Group - Status Report

Michele Michelotto (Università e INFN, Padova (IT))

27/03/2019, 14:00

Computing & Batch Services

The Benchmarking Working Group has been very active in the last months. The group observed that SPEC CPU 2017 is not very different from SPEC CPU 2006. On the worker node available the two benchmark are higly correlated. Analysis with Trident shows that the hardware counters usage is rather different from the HEP applications. So the group started to investigate the usage of real applications...

20. How Fair is my Fair-Sharing? Exposing Some Hidden Behavior Through Workload Analysis

Frederic Suter (CNRS / CC-IN2P3)

27/03/2019, 14:25

Computing & Batch Services

Monitoring and analyzing how a workload is processed by a job and resource management system is at the core of the operation of data centers. It allows operators to verify that the operational objectives are satisfied, detect any unexpected and unwanted behavior, and react accordingly to such events. However, the scale and complexity of large workloads composed of millions of jobs executed...

14. Evolution of interactive data analysis for HEP at CERN – SWAN, Kubernetes, Apache Spark and RDataFrame

Piotr Mrowczynski (CERN)

27/03/2019, 14:50

Computing & Batch Services

This talk is focused on recent experiences and developments in providing data analytics platform SWAN based on Apache Spark for High Energy Physics at CERN.

The Hadoop Service expands its user base for analysts who want to perform analysis with big data technologies - namely Apache Spark – with main users from accelerator operations and infrastructure monitoring. Hadoop Service integration...

39. Jupyter at SDCC

William Strecker-Kellogg (Brookhaven National Lab)

27/03/2019, 15:15

Computing & Batch Services

...Placeholder...

6. Computing/Storage/Networking for next generation photon science experiments @DESY

Mr Martin Gasthuber (DESY)

27/03/2019, 16:10

Computing & Batch Services

We will briefly show the current onsite accelerator infrastructure and their resulting computing and storage usage and future requirements. The second section will discuss the plans and work done regarding the hardware infrastructure, the system level middleware (i.e. container, storage connection, networks) and the higher level middleware (under development) covering low latency data access...

15. Swiss HPC Tier-2 Computing @ CSCS

Mr Dino Conciatore (CSCS (Swiss National Supercomputing Centre))

27/03/2019, 16:35

Computing & Batch Services

For the past 10 years, CSCS has been running compute capability in the WLCG Tier-2 for ATLAS, CMS and LHCb on standard commodity hardware (a cluster named Phoenix). Three years ago, CSCS began providing this service on the flagship High Performance Computing (HPC) system, Piz Daint (a Cray XC40/50 system). Piz Daint is a world-class HPC system with over 1800 dual-processor multicore nodes and...

60. Deep learning in a container, experience and best practices

Frederic Suter

27/03/2019, 17:00

Computing & Batch Services

Deep Learning techniques are gaining interest in the High Energy Physics, following a new and efficient approach to solve different problems. These techniques leverage the specific features of GPU accelerators and rely on a set of software packages allowing users to compute on GPUs and program Deep Learning algorithms. However, the rapid pace at which both the hardware and the low and high...