pre-GDB - Benchmarking
→
Europe/Zurich
31/S-028 (CERN)
Description
Monthly meeting of the WLCG Grid Deployment Board
See also Twiki GDB area for actions and summaries
-
-
1
Speakers: Domenico Giordano (CERN), Manfred Alef (Karlsruhe Institute of Technology (KIT)), Michele Michelotto (Università e INFN, Padova (IT))
-
2
Speaker: Domenico Giordano (CERN)
-
3
Speaker: Nick Ziogas (CERN)
Here we collect a list of question to be discussed during the session
-
The benchmark should be usable (and not modifiable) by others (e.g.: hardware vendors)
- In their invitations to tender the sites ask the hardware vendors for benchmark results.
- It is mandatory to grant licenses of the new benchmark suite to the hardware vendors.
- As an example SPEC benchmarks are publicly available (not for free, but its an industry standard benchmark, and the major hardware vendors have purchased their individual license).
- Other benchmarks as whetstone, linpack are publicly available for free but are not replicating HEP performances
-
What is the public license models suggested by CERN?
- We note that some public license models require that not only binaries but also the source code will be distributed if requested!)
- The suite is very flexible and configurable but it is important that the score used to assess the performances of the CPU nodes, both for the procurements and for the pledges will run without modifications.
-
How the license of the included packages affects the license of our product?
- we do not rebuild the experiment software. We just install it (copying from cvmfs) and distribute via containers
- In addition we install software from public repositories, via yum install (from CERN, EPEL, WLCG repos) and pip install
-
Copyrights
- The new benchmark tool is a composite work of several authors from several sites.
- What are the best practices to acknowledge the work done by each contributor?
- Is a contributor file in the repo enough?
- shall each file contain the header with the author list? (Hopefully not)
- Shall each contributor sign a document giving the right to CERN to distribute this package? Is that implicit if we put a license?
- Is Zenodo an alternative to claim Copyrights? or is it in addition?
-
-
12:00
Lunch
-
Conveners: Andrea Sciaba (CERN), Andrea Sciabà (CERN), Andrea Valassi (CERN), Lorenzo Rinaldi (Universita e INFN, Bologna (IT)), Martina Javurkova (Albert Ludwigs Universitaet Freiburg (DE)), Olga Vladimirovna Datskova (University of Houston (US))
-
4
Infrastructure of container buildSpeakers: Andrea Valassi (CERN), Domenico Giordano (CERN)
-
5
Readiness of WL benchmark candidates
Overview, configuration, tests of the HEP WL proposed as benchmark components
Speakers: Andrea Sciaba (CERN), Andrea Sciabà (CERN), Andrea Valassi (CERN), Martina Javurkova (Albert Ludwigs Universitaet Freiburg (DE)), Olga Vladimirovna Datskova (University of Houston (US))-
a) AtlasSpeakers: Lorenzo Rinaldi (Universita e INFN, Bologna (IT)), Martina Javurkova (Albert Ludwigs Universitaet Freiburg (DE))
-
b) AliceSpeakers: Costin Grigoras (CERN), Olga Vladimirovna Datskova (University of Houston (US))
-
c) CMSSpeakers: Andrea Sciaba (CERN), Dr Andrea Sciabà (CERN)
-
d) LHCbSpeaker: Andrea Valassi (CERN)
-
-
4
-
Convener: Christopher Henry Hollowell (Brookhaven National Laboratory (US))
-
6
How to compute and collect HEPscoresSpeaker: Domenico Giordano (CERN)
-
7
Design of the HEP scoreSpeaker: Christopher Henry Hollowell (Brookhaven National Laboratory (US))
-
8
Reproducibility, robustness, usabilitySpeaker: Manfred Alef (Karlsruhe Institute of Technology (KIT))
-
6
-
15:20
Break
-
-
9
Overview of the GPU efforts for WLCG production workloadsSpeaker: Andrea Valassi (CERN)
- 10
-
11
CMS WL as GPU benchmarkSpeakers: Andrea Sciaba (CERN), Andrea Sciabà (CERN), Viktor Khristenko (CERN)
- 12
-
9
-
1