ATLAS Sites Jamboree and HPC strategy

Name: ATLAS Sites Jamboree and HPC strategy
Start: 2019-03-05T09:00:00+01:00
End: 2019-03-08T15:00:00+01:00
Location: No location set

5 Mar 2019, 09:00 → 8 Mar 2019, 15:00 Europe/Zurich

Alessandro Di Girolamo (CERN), Davide Costanzo (University of Sheffield (GB)), James Catmore (University of Oslo (NO)), Johannes Elmsheuser (Brookhaven National Laboratory (US))

Description

Pizza:

Wednesday evening starting at 18:30.
NEED to sign in by Monday 3rd of March the latest: https://doodle.com/poll/nues46vzyweppnpa

Guided Tours:

Inside DataCentre visits:
- Doodle: https://doodle.com/poll/p78c9wbwxwcpbgdi
- Limit: 18 persons
- Dates:
  - Wed 6th March, 12:45-13:45
  - Fri 8th March, 12:45-13:45
ATLAS VisitorsCentre visit:
- Doodle: https://doodle.com/poll/ubir3tdccnhmikyx
- Limit: 24 persons
- Dates:
  - Tue 5th March, 17:00-18:00
  - Thu 7th March, 17:30-18:30

Live minutes:

Live minutes (feel free to edit, please add your name in case of not clear actions/decisions)

Feedback:

https://goo.gl/forms/9Q5CRDwQLFjjvu3k2

Tuesday 5 March
- EventIndex Workshop 42/3-002 (CERN)
  
  42/3-002
  
  CERN
  
  30
  Show room on map
  
  Convener: Dario Barberis (Università e INFN Genova (IT))
  
  Agenda for EventIndex Workshop
- HPC usage and strategy 31/S-028 (CERN)
  
  31/S-028
  
  CERN
  
  30
  Show room on map
  - 1
    
    ATLAS & HPCs: welcome, introduction, needs and vision
    
    Speakers: Davide Costanzo (University of Sheffield (GB)), James Catmore (University of Oslo (NO))
    
    HPC_jamboreeMarch2019.pdf
  - 2
    
    summary of 1st October HPC mini-TIM
    
    Speaker: Doug Benjamin (Argonne National Laboratory (US))
    
    agenda of 1st October HPC mini-TIM
    
    DougB-MiniTim-Recap.pdf
    
    DougB-MiniTim-Recap.pptx
  - 3
    
    Emerging Hardware
    
    Speaker: David Vicente
    
    A64FX.pdf
    
    BSC-CERN.pdf
  - 15:00
    
    coffee
  - 4
    
    HPC in Europe - overview
    
    Speaker: Andrej Filipcic (Jozef Stefan Institute (SI))
    
    EU HPCs (1).pdf
  - 5
    
    ATLAS I/O review: HPC related topics
    
    Speaker: Peter Van Gemmeren (Argonne National Laboratory (US))
    
    ATLAS_IO_HPC.pdf
    
    ATLAS_IO_HPC.pptx
  - 6
    
    SW challenges for heterogeneous resources
    
    Speaker: Vakho Tsulaia (Lawrence Berkeley National Lab. (US))
    
    HeterogeneousResources.pdf
    
    HeterogeneousResources.pptx
Wednesday 6 March
- HPC usage and strategy 31/S-028 (CERN)
  
  31/S-028
  
  CERN
  
  30
  Show room on map
  - 7
    
    Porting SW to HPC
    
    Speaker: Alexander Undrus (Brookhaven National Laboratory (US))
    
    undrus_hpcstrategy_Mar062019_V2.pdf
  - 8
    
    Containers for HPC
    
    Speaker: Wei Yang (SLAC National Accelerator Laboratory (US))
    
    Containers for HPCs
    
    Containers for HPCs, 2019-03-06.pdf
  - 9
    
    Containers: HPC and Grid
    
    Speaker: Alessandra Forti (University of Manchester (GB))
    
    20190305_jamboree_containers.pdf
  - 10
    
    GPUs
    
    Speaker: Lukas Alexander Heinrich (CERN)
    
    Jamboree.pdf
  - 11
    
    Distributed Computing challenges
    
    Speakers: Doug Benjamin (Argonne National Laboratory (US)), Fernando Harald Barreiro Megino (University of Texas at Arlington), Nicolo Magini (Iowa State University (US)), Tadashi Maeno (Brookhaven National Laboratory (US))
    
    Data-Access-HPC-issues.pdf
    
    Data-Access-HPC-issues.pptx
    
    Jamboree and HPC strategy.pdf
  - 10:45
    
    coffee
  - 12
    
    pilot2
    
    Speaker: Paul Nilsson (Brookhaven National Laboratory (US))
    
    Pilot 2, Jamboree, 06.03.2019.pdf
  - 13
    
    ML activities and plans
    
    Speaker: Dan Guest (University of California Irvine (US))
    
    ML Activities and Plans, HPC strategy meeting March 2019(1).pdf
    
    Updated Slides
- 12:30
  
  Lunch break
- ATLAS Sites Jamboree: welcome and overviews 40/S2-C01 - Salle Curie (CERN)
  
  40/S2-C01 - Salle Curie
  
  CERN
  
  115
  Show room on map
  - 14
    
    ATLAS Sites Jamboree: welcome and introduction
    
    Speakers: Alessandro Di Girolamo (CERN), Johannes Elmsheuser (Brookhaven National Laboratory (US))
    
    ATLAS Sites Jamboree - March 2019.pdf
  - 15
    
    SW & C overview
    
    Speakers: Davide Costanzo (University of Sheffield (GB)), James Catmore (University of Oslo (NO))
    
    Jamboree_20190305.pdf
  - 16
    
    SW status and plans
    
    Speakers: Edward Moyse (University of Massachusetts (US)), Walter Lampl (University of Arizona (US))
    
    SoftwareStatusForADC_March18.pdf
  - 17
    
    Reprocessing plans
    
    Speakers: Joe Taenzer (Tel Aviv University (IL)), Soeren Andre Prell (Iowa State University (US))
    
    sitesjamboree_DATREP.pdf
  - 18
    
    Distributed Analysis - overview
    
    Speakers: Jose Enrique Garcia Navarro (Univ. of Valencia and CSIC (ES)), Priscilla Pani (Deutsches Elektronen-Synchrotron Campus Zeuthen (DE))
    
    DA_Jamboree_0319.pdf
  - 19
    
    Derivations plans
    
    Speakers: Dr Eirik Gramstad (University of Oslo (NO)), Monica Dobre (IFIN-HH (RO))
    
    Derivations plans March 5 2019.pdf
  - 15:35
    
    coffee
  - 20
    
    MC production: plans and new workflows
    
    Speakers: David Michael South (Deutsches Elektronen-Synchrotron (DE)), Dominic Hirschbuehl (Bergische Universitaet Wuppertal (DE))
    
    mccoord_060319.pdf
  - 21
    
    Containers
    
    Speaker: Alessandra Forti (University of Manchester (GB))
    
    20190306_jamboree_containers.pdf
  - 22
    
    ADC & Sites configuration - overview and suggestions
    
    Speaker: Andrej Filipcic (Jozef Stefan Institute (SI))
    
    ADC & Sites configuration (1).pdf
- 18:00
  
  Pizza (for real this time)
  
  in Restaurant1. 20CHF each.
  
  You NEED to sign in by Monday 3rd of March the latest
  https://doodle.com/poll/nues46vzyweppnpa
Thursday 7 March
- ATLAS Sites Jamboree: configuration, workflows 40/S2-C01 - Salle Curie (CERN)
  
  40/S2-C01 - Salle Curie
  
  CERN
  
  115
  Show room on map
  - 23
    
    DOMA activities: TPC and QoS
    
    Data Organization and Management Activities: Third Party Copy and (storage) Quality of Service
    
    Speaker: Alessandra Forti (University of Manchester (GB))
    
    20190307_jamboree_doma.pdf
  - 24
    
    TPC: details on DPM
    
    Speaker: Petr Vokac (Czech Technical University (CZ))
    
    dpm_upgrade.pdf
  - 25
    
    DOMA ACCESS: Caches
    
    Speakers: Ilija Vukotic (University of Chicago (US)), Stephane Jezequel (LAPP-Annecy CNRS/USMB (FR))
    
    Cache_Jamboree19.odp
    
    Cache_Jamboree19.pdf
    
    Scheduling with Virtual Placement for Site Jamboree.pdf
    
    Virtual Placement and scheduling with caches
  - 10:00
    
    coffee
  - 26
    
    DDM Ops overview
    
    Speakers: Cedric Serfon (University of Innsbruck (AT)), Dimitrios Christidis (University of Texas at Arlington (US))
    
    2019-03-07 - DDM ops overview.pdf
  - 27
    
    DPA overview
    
    Speakers: Ivan Glushkov (University of Texas at Arlington (US)), Rodney Walker (Ludwig Maximilians Universitat (DE))
    
    DPA Overview.pdf
  - 28
    
    Payload submission: Harvester
    
    Speakers: Fernando Harald Barreiro Megino (University of Texas at Arlington), Tadashi Maeno (Brookhaven National Laboratory (US))
    
    Grid Harvester
  - 29
    
    Payload submission with Kubernetes
    
    Speaker: Ricardo Brito Da Rocha (CERN)
    
    Deploying and Operating Kubernetes.pdf
  - 30
    
    Event streaming service
    
    Speaker: Wen Guan (University of Wisconsin (US))
    
    EventStreamingService-201903(1).pdf
  - 12:50
    
    Lunch break
  - 31
    
    Diskless and lightweight sites: consolidation of storage
    
    Speaker: Stephane Jezequel (LAPP-Annecy CNRS/USMB (FR))
    
    Diskless_Jamboree19.odp
    
    Diskless_Jamboree19.pdf
  - 32
    
    Lightweight sites: remote deployment with Slate
    
    Speaker: Robert William Gardner Jr (University of Chicago (US))
    
    Deploying Services with SLATE (1).pdf
  - 33
    
    Lightweight sites: WLCG ideas
    
    Speakers: Maarten Litmaath (CERN), Mayank Sharma (CERN)
    
    SIMPLE-16-9-ATLAS_JAMBOREE-2019-v2.pdf
    
    SIMPLE-16-9-ATLAS_JAMBOREE-2019-v2.pptx
  - 34
    
    Lightweight sites: BOINC backfilling
    
    Speaker: Shaojun Sun (University of Wisconsin Madison (US))
    
    BOINC-Harvester-ATLAS_Jamboree-2019.pdf
    
    Lightweight sites: BOINC Backfilling
  - 35
    
    Automation and blacklisting: overview
    
    Speaker: Jose Caballero Bejar (Brookhaven National Laboratory (US))
    
    ATLAS Blacklisting_ Sites Jamboree 2019 (1).pdf
  - 15:50
    
    coffee
  - 36
    Monitoring and analytics for sites
    
    Speakers: Dario Barberis (Università e INFN Genova (IT)), Ilija Vukotic (University of Chicago (US)), Thomas Beermann (University of Innsbruck (AT))
    
    a) News on the New Dashboards
    
    Speaker: Thomas Beermann (University of Innsbruck (AT))
    
    ATLAS Site Jamboree Dashboard Update 03_2019.pdf
    
    b) News from Analytics for sites
    
    Speaker: Ilija Vukotic (University of Chicago (US))
    
    ADC Analytics 2019-03-07.pdf
    
    Analytics news
  - 37
    
    ADC Shifts overview
    
    Speaker: Mayuko Kataoka (University of Texas at Arlington (US))
    
    ADCShiftOverview_Jamboree070319.pdf
  - 38
    
    Database overview
    
    Speakers: Andrea Formica (Université Paris-Saclay (FR)), Elizabeth Gallas (University of Oxford (GB)), Nurcan Ozturk (University of Texas at Arlington (US)), Shaun Roe (CERN)
    
    Databases_March2019.pdf
    
    DatabasesOverviewMarch2019
  - 39
    
    Operational Intelligence ideas
    
    Speaker: Alessandro Di Girolamo (CERN)
    
    Operational Intelligence - ATLAS Sites Jamboree March 2019.pdf
- Databases and Conditions 40/R-D10 (CERN)
  
  40/R-D10
  
  CERN
  
  20
  Show room on map
  
  Conveners: Andrea Formica (Université Paris-Saclay (FR)), Elizabeth Gallas (University of Oxford (GB)), Nurcan Ozturk (University of Texas at Arlington (US)), Shaun Roe (CERN)
  - 40
    
    Database Operations and Conditions DB Developments
    
    Agenda for DB Operation and Conditions Developments
Friday 8 March
- ATLAS Sites Jamboree: Infrastructure evolution 40/S2-C01 - Salle Curie (CERN)
  
  40/S2-C01 - Salle Curie
  
  CERN
  
  115
  Show room on map
  - 41
    
    Data Carousel
    
    Speaker: Xin Zhao (Brookhaven National Laboratory (US))
    
    Updates on Data Carousel (4).pdf
  - 42
    
    Authorization & Authentication evolution
    
    Speaker: Andrea Ceccanti (Universita e INFN, Bologna (IT))
    
    Beyond-X509-Atlas-Jamboree.pdf
  - 43
    
    Networking - best practice for sites, and evolution
    
    Speaker: Shawn Mc Kee (University of Michigan (US))
    
    Networking - Best Practice for Sites, and Evolution.pdf
  - 10:15
    
    coffee
  - 44
    
    WLCG evolution strategy
    
    Speaker: Simone Campana (CERN)
    
    WLCGEvolutionATLASJamboree.pdf
    
    WLCGEvolutionATLASJamboree.pptx
  - 45
    
    Analysis Model evolution for Run-3: AMSG-R3
    
    Speaker: Johannes Elmsheuser (Brookhaven National Laboratory (US))
    
    c_080319.pdf
  - 46
    
    Cost and system performance modelling in WLCG
    
    Speaker: Dr Andrea Sciabà (CERN)
    
    Cost model ATLAS site jamboree.pdf
    
    Cost model ATLAS site jamboree.pptx
  - 47
    
    Summary of HPC technical meeting
    
    Speakers: Alexei Klimentov (Brookhaven National Laboratory (US)), Andrej Filipcic (Jozef Stefan Institute (SI))
    
    summary of HPC (1).pdf
  - 48
    
    Close-out
    
    Speakers: Alessandro Di Girolamo (CERN), Johannes Elmsheuser (Brookhaven National Laboratory (US))
    
    c_080319_2.pdf

ATLAS Sites Jamboree and HPC strategy

42/3-002

CERN

31/S-028

CERN

31/S-028

CERN

40/S2-C01 - Salle Curie

CERN

40/S2-C01 - Salle Curie

CERN

40/R-D10

CERN

40/S2-C01 - Salle Curie

CERN