pre-GDB - Benchmarking

Tuesday 8 Oct 2019, 09:30 → 18:00 Europe/Zurich

31/S-028 (CERN)

Monthly meeting of the WLCG Grid Deployment Board See also Twiki GDB area for actions and summaries

11:00 → 11:05 Welcome¶

Speakers: Domenico Giordano (CERN), Manfred Alef (Karlsruhe Institute of Technology (KIT)), Michele Michelotto (Università e INFN, Padova (IT))

11:05 → 11:25 Overview of the activity of the Benchmarking WG¶

Speaker: Domenico Giordano (CERN)

pre-GDB-8-10-2019-giordano-intro.pdf

11:25 → 11:55 Discussion on licence aspects¶

Speaker: Nick Ziogas (CERN)

Here we collect a list of question to be discussed during the session

1. The benchmark should be usable (and not modifiable) by others (e.g.: hardware vendors)

   • In their invitations to tender the sites ask the hardware vendors for benchmark results.
   • It is mandatory to grant licenses of the new benchmark suite to the hardware vendors.
     • As an example SPEC benchmarks are publicly available (not for free, but its an industry standard benchmark, and the major hardware vendors have purchased their individual license).
     • Other benchmarks as whetstone, linpack are publicly available for free but are not replicating HEP performances

2. What is the public license models suggested by CERN?

   • We note that some public license models require that not only binaries but also the source code will be distributed if requested!)
   • The suite is very flexible and configurable but it is important that the score used to assess the performances of the CPU nodes, both for the procurements and for the pledges will run without modifications.

3. How the license of the included packages affects the license of our product?

   • we do not rebuild the experiment software. We just install it (copying from cvmfs) and distribute via containers
   • In addition we install software from public repositories, via yum install (from CERN, EPEL, WLCG repos) and pip install

4. Copyrights

   • The new benchmark tool is a composite work of several authors from several sites.
   • What are the best practices to acknowledge the work done by each contributor?
     • Is a contributor file in the repo enough?
     • shall each file contain the header with the author list? (Hopefully not)
     • Shall each contributor sign a document giving the right to CERN to distribute this package? Is that implicit if we put a license?
   • Is Zenodo an alternative to claim Copyrights? or is it in addition?

12:00 → 13:00 Lunch

13:00 → 14:30 HEP reference Workloads¶

Conveners: Andrea Sciaba (CERN), Andrea Sciabà (CERN), Andrea Valassi (CERN), Lorenzo Rinaldi (Universita e INFN, Bologna (IT)), Martina Javurkova (Albert Ludwigs Universitaet Freiburg (DE)), Olga Vladimirovna Datskova (University of Houston (US))

13:00 Infrastructure of container build¶

Speakers: Andrea Valassi (CERN), Domenico Giordano (CERN)

20191008-preGDB-bmk-AV-infra-v001.pdf

20191008-preGDB-bmk-AV-infra-v001.pptx

13:30 Readiness of WL benchmark candidates¶

Overview, configuration, tests of the HEP WL proposed as benchmark components

Speakers: Andrea Sciaba (CERN), Andrea Sciabà (CERN), Andrea Valassi (CERN), Martina Javurkova (Albert Ludwigs Universitaet Freiburg (DE)), Olga Vladimirovna Datskova (University of Houston (US))

14:30 → 15:20 HEP score¶

Convener: Christopher Henry Hollowell (Brookhaven National Laboratory (US))

14:30 How to compute and collect HEPscores¶

Speaker: Domenico Giordano (CERN)

pre-GDB-8-10-2019-giordano-hepscore.pdf

14:45 Design of the HEP score¶

Speaker: Christopher Henry Hollowell (Brookhaven National Laboratory (US))

hepscore_pregdb.pdf

15:05 Reproducibility, robustness, usability¶

Speaker: Manfred Alef (Karlsruhe Institute of Technology (KIT))

Benchmark_Validation-2019-10-08.pdf

15:20 → 15:40 Break

15:40 → 17:00 Benchmarking HPC and GPUs¶

15:40 Overview of the GPU efforts for WLCG production workloads¶

Speaker: Andrea Valassi (CERN)

20191008-preGDB-bmk-AV-gpus-v001.pdf

20191008-preGDB-bmk-AV-gpus-v001.pptx

16:00 CMS GPU WLs (Patatrack)¶

Speaker: Felice Pantaleo (CERN)

20191008_Felice_Benchmark_739897.pdf

16:15 CMS WL as GPU benchmark¶

Speakers: Andrea Sciaba (CERN), Andrea Sciabà (CERN), Viktor Khristenko (CERN)

GPU benchmarking with Patatrack.pdf

GPU benchmarking with Patatrack.pptx

16:30 HPC pledge equivalence¶

Speaker: Markus Schulz (CERN)

HPC pledges