DOMA / ACCESS Meeting

Tuesday 24 Mar 2020, 17:30 → 18:50 Europe/Zurich

513/1-024 (CERN)

Frank Wuerthwein (Univ. of California San Diego (US)), Ilija Vukotic (University of Chicago (US)), Markus Schulz (CERN), Stephane Jezequel (LAPP-Annecy CNRS/USMB (FR)), Xavier Espinal (CERN)

People on Vidyo: Andrea Sciaba, Derek Weitzel, Diego Ciangottini, Dirk Duellmann, Eric Fede, Riccardo Di Maria, Xavier Espinal, David Smith, Martin Gasthuber, Oxana Smirnova, Frank Wuerthwein, Ilija Vukotic, Laurent Duflot, Nikola Hardi, Nikolai Marcel Hartmann, Stephane Jezequel, Teng LI, tigran

 

• DOMA general meeting will take place on March 25th at 4pm. Agenda and vidyo details are available at: https://indico.cern.ch/event/901410/

 

• Dr Teng LI (University of Edinburgh, UK) - XCache and future plans of diskless sites at GridPP:
  - the resources (mostly consumed by ATLAS, CMS) are highly concentrated
  - the current simplest solution: diskless site with direct access to a nearby large SE
  Birmingham (attached to Manchester), Sheffield (attached to RAL ECHO), Cambridge (attached to QMUL), ECDF (none-diskless site, running XCache)
  - comparison of Birmingham production queue and ECDF analysis queue: cache hit rate at 50-70 % and production queue is more ‘cache-able’
  - metric collector container developed at ECDF: XCache logging, cached files and OS, host information, cache hit/miss, cached files
  - BHAM: running very smoothly for 7 months
  - metrics collected from BHAM: 9310 (6.6T) files written to cache; 48426 (20.8T) read requests
  - even with one node, cache will not be filled; these are production jobs using tiny amount of data
  - one could increase the pressure on the site for both simulation and I/O jobs by changing the load
  - the cache should be pushed to the limit before summarise
  - popular files are related to HC tests
  - Sheffield: analysis jobs use direct I/O; production jobs use copy-to-scratch -> huge difference
  - indirect access good as long as you keep connection open over (even long) time
  - better to have direct access when it comes to cache
  - summarising: 3 diskless sites attached to nearby large sites; Cambridge and Birmingham running XCache; positive experience with Birmingham; Sheffield under investigation; if more sites joining, plan to investigate cache federation
  - cache federation should be followed up since the plan is not clearly defined
  - wrt CMS: RAL should have tested with AAA

 

• DOMA ACCESS White Paper and HL-LHC review document preparations
  - DOMA ACCESS "White Paper"
  https://docs.google.com/document/d/1VfzXNIAM8AlrA_9EPntCP99UyVSws6S6-ZDdieqItVg
  - HL-LHC review:
  https://docs.google.com/document/d/1KglUSvYm2l7GT2qkKSTrNTSrpxXsWezQsl9dRYc-1rU
  
  ACTIONS: insert table with CMS and ATLAS information; insert information wrt “treading of cost between network and caches”
  
   
• Next meeting in 2 weeks

17:30 → 17:35 Introduction

Speakers: Frank Wuerthwein (UCSD), Frank Wuerthwein (Univ. of California San Diego (US)), Ilija Vukotic (University of Chicago (US)), Stephane Jezequel (LAPP-Annecy CNRS/USMB (FR))

DOMA general meeting will take place tomorrow 25th March at 4pm. Agenda and vidyo details are available at: https://indico.cern.ch/event/901410/

17:35 → 17:55 XCache and future plans of diskless sites at GridPP

Speaker: Dr Teng LI (University of Edinburgh, UK)

diskless.pdf

diskless.pptx

17:55 → 18:20 DOMA ACCESS White Paper and HL-LHC review document preparations

• DOMA ACCESS "White Paper"
  https://docs.google.com/document/d/1VfzXNIAM8AlrA_9EPntCP99UyVSws6S6-ZDdieqItVg
• HL-LHC review:
  https://docs.google.com/document/d/1KglUSvYm2l7GT2qkKSTrNTSrpxXsWezQsl9dRYc-1rU

18:20 → 18:30 AOB