Focus on:  Hide Contributions
Back to Conference View
Login

HEPscore Workshop

→ Europe/Zurich
513/1-024 (CERN)

513/1-024

CERN

50
Show room on map
Description

The goal of the workshop is to define the strategy for the adoption of HEPscore as replacement of HepSpec06. 

The HEPSpec06 benchmark has been a reliable estimate of CPU performance for many years, and is currently used by the WLCG for accounting and pledges.  However, HEPSpec06 is based on the SPEC2006 benchmark that is no longer supported.  Further, it uses applications that do not reflect those used by the HEP community and will not provide benchmark for the new CPU+GPU systems.

The HEPscore Workshop will consist of several sessions: 

Monday September 19

The first session will summarize the work of the WLCG HEPscore Task Force and the HEPiX Benchmark Working Group. During the session, potential candidates for the new HEPScore22 benchmark will be introduced. 

The second session is devoted to the presentation of the current HEP-Workloads provided in the past year by the LHC experiments, Belle2, Juno and IWGN. Besides a description of the applications and of their performance, representatives of each experiment will highlight their expectations about the HEPscore22 composition and its lifetime.

The last session will introduce the framework developed to run HEP benchmarks and collect benchmark measurements ensuring traceability and monitoring. The HEP Benchmark Suite will be described and feedback about its usability will be provided by WLCG sites having used the suite.

Tuesday September 20

The morning session will focus on the policy and strategy foreseen to evolve from HepSpec06 to HEPscore, and the implications to accounting, pledging and procurement. The session will start with presentations from members of the Accounting Task Force, regarding the status of the development and the proposed deployment strategies. A round table with all the stakeholders will follow the presentations.

The last session is named "beyond x86". It will cover R&D work done by the Benchmarking Working Group in the area of heterogeneous computing, in order to extend HEPScore also to the benchmarking of servers with GPUs. In addition, there will be presentations on CPU power consumption and its relation to HEPScore.

 

Please register to the workshop to communicate if you will attend via zoom or in person.

 

Notes of the workshop are available for the registered participants as codiMD document in CERNbox at this url

Registration
Registration
Register
HEPscore Workshop
Zoom Meeting ID
67043427468
Host
Domenico Giordano
Useful links
Join via phone
Zoom URL
  • Monday 19 September
  • Tuesday 20 September
    • 09:00 → 11:00
      Strategy to deploy HEPscore

      2 Items
      - discuss the strategy foreseen by the accounting WG to deploy HEPscore beside HS06, and collect results
      - recommend the HEP workloads mix and weight of HEPscore22

      Summary.pdf
      • 09:00
        Welcome and intro to the 2nd day 5m
        Speakers: Domenico Giordano (CERN), Randall Sobie (University of Victoria (CA))
        WLCG-HEPscore-Workshop-19-20-09-2022-giordano-session-4.pdf
      • 09:05
        HEPscore in the accounting system: Operational Strategy 25m
        • what is the deployment plan of a new benchmark?
        • how sites should contribute?
        • what is the possible time scale (months, years)
        • how the pledges and procurement should then start to include HEPscore
          (in parallel to HS06 at first, to then gradually replace it)
        • What are the validation procedures foreseen in these phases?
        • how often a benchmark should/could be changed? every 4-5 years (at each LS?)
        Speakers: Julia Andreeva (CERN), Maarten Litmaath (CERN)
        NewBenchmarkWSSep22.pdf
      • 09:30
        HEPscore in the accounting system: Development Status 15m
        • Description of the software changes, ETA, risks
        • Implications /dependencies from other components that will require modifications (ARC and HTCondor CE, EGI portal, WAU, etc)
        Speaker: Adrian Coveney (STFC UKRI)
        2022-09-20 HEPscore in Accounting - Development Status.pdf
      • 09:45
        Considerations around a benchmark change 10m
        Speaker: Bernd Panzer-Steindel (CERN)
        HEPScore_considerations_BPS.pdf
      • 09:55
        Round table: HEPscore22 and adoption process 40m

        On the basis of what has been presented in the workshop, gather the feedback of the participants about:
        - the HEP workload mix that better satisfies the WLCG requirements (representativeness, runtime duration, size)
        - the operational process for HEPscore adoption in the Accounting system (timescale, validation, frequency of future upgrades, ...)

        Speaker: round table
        Day1Summary.pdf
      • 10:35
        Coffee break 25m
    • 11:00 → 15:20
      Developments beyond x86 CPUs

      We will cover the extension of HEPscore to GPUs workloads, the build of CPU workloads on ARM/Power, fast benchmarks, the usage of HEP workloads for measurements of Power consumption

    • 15:20 → 16:00
      Strategy to deploy HEPscore: Conclusions

      2 Items
      - discuss the strategy foreseen by the accounting WG to deploy HEPscore beside HS06, and collect results
      - recommend the HEP workloads mix and weight of HEPscore22

      Summary.pdf
Powered by Indico v3.3.6-pre