BigPanDA Technical Interchange Meeting

24 Apr 2019, 09:30 → 25 Apr 2019, 13:05 US/Eastern

BNL

Alexei Klimentov (Brookhaven National Laboratory (US)), Kaushik De (University of Texas at Arlington (US)), Sergey Panitkin (Brookhaven National Laboratory (US))

BigPanDA Workflow Management on Titan for High Energy and Nuclear Physics and for Future Extreme Scale Scientific Applications.

 

Connectivity for  sessions via vydio

Wednesday, 24 April

09:30 → 09:50 coffee break

09:50 → 12:00 Status reports (room 1-224)

Convener: Alexei Klimentov (Brookhaven National Laboratory (US))

09:50 ATLAS @ OLCF

Harvester and pilot
ATLAS Monte-Carlo Production on Titan
ALCC vs backfill
SW developed and installed
ATLAS SW releases for Titan and beyond
Lessons learned

Speakers: Alexander Undrus (Brookhaven National Laboratory (US)), Danila Oleynik (Joint Institute for Nuclear Research (RU))

ATLAS@OLCF_F2F_BNL.pdf

Summit_performance_v1.pdf

Summit_performance_v1.pptx

undrus_bigpanda_April242019.pdf

10:35 BigPanDA project and non-LHC experiments (I) --> Thu morning (merged with II)

DUNE
LSST/DESC
MD
LQCD

Speakers: Pavlo Svirin (Brookhaven National Laboratory (US)), Ruslan Mashinistov (Russian Academy of Sciences (RU)), Sean Robert Wilkinson (University of Texas at Arlington (US)), Sergey Panitkin (Brookhaven National Laboratory (US))

DUNE_GPU_payload_update_v1.pdf

DUNE_GPU_payload_update_v1.pptx

10:55 preemption tests on Titan (presentation and discussion)

Speakers: Danila Oleynik (Joint Institute for Nuclear Research (RU)), Sean Robert Wilkinson (University of Texas at Arlington (US))

Preemption_tests_update.pdf

11:15 Distributed ML on Summit

ML for ATLAS and beyond

Speaker: Dr Abid Malik (Brookhaven National Laboratory (US))

ATLAS+HEP-BigPanda.pdf

ATLAS+HEP-BigPanda.pptx

12:00 → 12:20 ATLAS projects (I) - Event Streaming Service (iDDS) ----> Thu morning to (session II)

Speaker: Tadashi Maeno (Brookhaven National Laboratory (US))

iDDS.pdf

12:20 → 13:10 lunch break

13:10 → 15:10 BigPanDA publications, 2019 conferences, ....

Convener: Shantenu Jha (LSU)

13:10 Overview

13:20 Allocation Modeling paper + discussion

Speakers: Alexey Poyda (Kurchatov Institute), Mikhail Titov (National Research Centre Kurchatov Institute (RU))

intro

paper-DRAFT

13:50 Computing and Software for Big Science paper + round table discussion

Speakers: Sean Robert Wilkinson (University of Texas at Arlington (US)), Shantenu Jha (LSU)

Draft PDF

Slides

Source on GitHub

15:10 → 17:10 BigPanDA Operational Model (2019+)

Releases and instances
How PanDA support will be provided for non-ATLAS users.
(session may be shifted, and it depends from Arjun's availability)

forward looking discussion of future, especially for Summit. Multiple new features of the system and unknowns.

Speaker: Dr Jack Wells (ORNL)

PanDA@OLCF_2019+_Final.pdf

17:10 → 17:25 coffee break

17:25 → 18:25 PI's meeting

19:20 → 21:20 Dinner

Thursday, 25 April

09:00 → 09:15 coffee break

09:15 → 10:15 BigPanDA non-LHC experiments (I + II)

IceCube
nEDM
Pegasus
DUNE
LSST/DESC
MD
LQCD

(see changes on Wed agenda)

Speakers: Pavlo Svirin, Sean Robert Wilkinson (University of Texas at Arlington (US)), Sergey Panitkin (Brookhaven National Laboratory (US))

BigPanDA_TIM_BNL_25.04.2019.pdf

10:15 → 12:10 New workflows (HEP and beyond) room 1-224

Convener: Kaushik De (University of Texas at Arlington (US))

10:15 Next Generation Executor (looking back/ looking forward)

Speaker: Matteo Turilli (Rutgers University)

NGE Project Report Apr 2019 (1).pdf

10:45 ATLAS and HEP projects (I + II)

Data Lake
Data Carousel
ESS

(see changes on Wed agenda)

Speakers: Alexei Klimentov (Brookhaven National Laboratory (US)), Tadashi Maeno (Brookhaven National Laboratory (US))

Data Carousel Overview.pdf

Data Carousel Overview.pptx

11:25 discussion

12:10 → 12:40 wrap up