System performance modelling WG meeting

Europe/Zurich
600/R-001 (CERN)

600/R-001

CERN

15
Show room on map
  • Local: Andrea Sciabà, Andrea Valassi, Markus Schulz, Domenico Giordano, Alessandro Di Girolamo
  • Remote: Andrea Sartirana, Catherine Biscarat, Gareth Roy, Johannes Elmsheuser, Renaud Vernet.

Domenico: very good progress, we have (GEN)SIM workloads for all experiments working fine but for some connections to outside network.
Container building is automatic and we tested the conversion to Singularity images.
One way is to use the Docker image in Singularity, another way is to convert it into a Singularity image.
We are in contact with SFT to have a ROOT based analysis in containers.
LHCb started validation studies. We still need to containerise the other workloads
We need the experiment contacts to help on extracting the score metrics.
Frontier access must be rendered unnecessary.

Johannes: we'll try to find somebody to help you.
Alesssandro: you need a bit of time from many people. about containerisation, we need a named
person, maybe Lorenzo?
Andrea V.: for Alessandra the container is the goal, for us it's the means.
We need to have some help in removing network access, that's all.

Andrea V. gives is talk on testing the LHCb SIM workload with Docker.

Discussed the agenda workshop:

Markus: we need collect in a more structured way projects for students.
We could think of putting in a discussion on the relationship with DOMA (it could also be in the DOMA session).
Is it enough to have people in both activities? or better more formal cross reports?
Andrea Sc.: better to have reports for those of us who are not in DOMA.

Round table:

Andrea Sc.: I am analysing CMS popularity data for cache simulation.
Markus: the student (Corentin) picked up work again, studying latency impact depending on where data and the cache are located. He also picked up the latest version of the cms workload.
Markus: I am also looking at the life cycle of atlas data (replications, deletions, etc.).
I splitted TCO per unit of hs06 and tb/y by diff contributing factors and made the spreadsheet more readable.

Andrea Sc. also started collecting cost evolution data to check if 20%/y is still realistic (spoiler: it is not).

Gareth: we are seeing that cost is drastically underestimated; numbers are now preliminary and confidential.

Andrea Sa.: I sent some data to Renaud.
Catherine: I prepared the budget for France.
Renaud: Gareth, can you provide us with the ratio between what you replace and what you buy as growth?
Gareth: I will ask Dave.
Renaud: tried to contact sites, for estimates about predictions for tape systems as followup from my talk at archival WG.
I asked numbers about wan connectivity but never got an answer.
I looked at markus' spreadsheet, it looks like manpower contrib is quite low: our director found that about 50% of cost is on mapower. I have no more details, but for next meeting i'll try to have an official statement
and more data.

Markus: I suggest to copy the sheet and play with the input numbers. The manpower numbers for hours are what we really see at CERN.
We invested over the years in this installation, to  have it as efficient as possible.
I didn't put the CERN paychecks, only hours per server/year. The number very dependent on local realities.

Catherine: also for the French Tier-2's we do see 50% for salaries.

Markus: maybe we should discuss in more detail what goes into that effort. For example, I only took people involved in installing and looking after the stuff and people rnning the batch, etc.


 

There are minutes attached to this event. Show them.
    • 16:25 16:30
      News from benchmarking working group 5m
      Speaker: Domenico Giordano (CERN)
      Status of the work tracked in this twiki
       

      https://twiki.cern.ch/twiki/bin/view/HEPIX/HEP-Workloads

       
      Very good progress since the last meeting
       
      • GEN (or GEN-SIM) workloads packaged in containers for all the 4 experiments
        • images available in gitlab registry, have been used by several beta-testers
           
      • Improvement in the gitlab-ci infrastructure 
        • it takes care of the automation of the container builder
        • it eases the validation of changes through gitlab CI pipelines
        • Andrea Valassi is heavily contributing
           
      • From Docker to Singularity 
        • Chris Hollowell tested the conversion to singularity containers
        • presented at the last Benchmarking WG meeting (see slides)
           
      • Established collaboration with CERN-SFT, to have also ROOT based analysis in containers
        • See Danilo Piparo presentation at the last Benchmarking WG meeting (slides)
        • Those analyses can be parallelised at the level of O(100) cores
          • new regime of study
             
      • LHCb started the validation studies 
        • see A. Valassi talk
       
       
      There are chances for further collaborations. 
      • teams in Atlas (as reported by A. Forti) and CMS (as reported by P. Flix) are working to build standalone containers to run in HPC
        • As benchmarking WG, we have acquired good experience in this process and we believe this is the right time to collaborate and avoid duplication of work
        • Please attend the Benchmarking bi-weakly meetings
          • https://indico.cern.ch/category/1806/
       
      What is still missing:
      • Identification of 1 expert per experiment to bring the experiment know-how in the WG
        • It should contribute to:
          • containerisation of the remaining experiment workloads 
          • definition/validation of the metrics extracted from the experiment job, and used to build a score
             
        • The task list is documented https://twiki.cern.ch/twiki/bin/view/HEPIX/HEP-Workloads#Workloads
          •  Andrea Valassi for LHCb is an example of what is needed
             
        • NB: The lack of active participation of experiment experts can delay the integration of the workloads and their validation
          • see for example the need to remove Frontier from the jobs of CMS and ATLAS and replace sqlite files. 
            • https://twiki.cern.ch/twiki/bin/view/HEPIX/HEP-Workloads#Issue_List
       
       
    • 16:30 16:45
      LHCb standalone workload: Validation study 15m
      Speaker: Andrea Valassi (CERN)
    • 16:45 17:05
      Cost model session organisation 20m
    • 17:05 17:25
      Round table 20m