Workshop on workflow languages for HEP analysis

3 Apr 2024, 10:00 → 5 Apr 2024, 18:00 Europe/Zurich

IdeaSquare (CERN)

Clemens Lange (Paul Scherrer Institute (CH)), Jamie Gooding (Technische Universitaet Dortmund (DE)), Kyle Stuart Cranmer (University of Wisconsin Madison (US)), Lukas Alexander Heinrich (Technische Universitat Munchen (DE)), Matthew Feickert (University of Wisconsin Madison (US))

This workshop will bring together experts on workflow languages and workflow management tools from the HEP and broader scientific open source software communities, and facilitate a dialogue between them. The workshop is intended for developers of tools that build on workflow languages and advanced users of workflow languages in HEP contexts, though anyone interested is welcome to register.

There are no workshop fees. However, the in-person registration will be limited given room space constraints at CERN. There will be a remote connection made available for those who would like to attend the workshop but are not able to attend in-person.

• Group live notes
• IRIS-HEP SSL BinderHub
  
  

This event is sponsored in part by the National Science Foundation through grants OAC-2226378, OAC-2226379 and OAC-2226380 (FAIROS-HEP) Any opinions, findings, conclusions or recommendations expressed in this material are those of the developers and do not necessarily reflect the views of the National Science Foundation.

We acknowledge funding from the European Union Horizon 2020 research and innovation programme, call H2020-MSCA-ITN-2020, under Grant Agreement n. 956086 (SMARTHEP).

Workshop photos:
* Group photo 1
* Group photo 2

Recording on CDS: Day 1

Recording on CDS: Day 2

Recording on CDS: Day 3

Wednesday 3 April

10:00 → 12:00 Session

Conveners: Lukas Alexander Heinrich (Technische Universitat Munchen (DE)), Matthew Feickert (University of Wisconsin Madison (US))

10:00 Workshop Introduction

Speaker: Matthew Feickert (University of Wisconsin Madison (US))

workshop_overview.pdf

10:20 Snakemake Overview

Speaker: Johannes Köster

Slides

11:10 CWL Overview

Speaker: Michael Crusoe (Common Workflow Language project / Zuse Institute Berlin)

2024-04-03 CWL Update for CERN workshop on workflow languages for particle physics analysis.pdf

CWL 2017→2024 update

14:00 → 18:30 Session

Conveners: Lukas Alexander Heinrich (Technische Universitat Munchen (DE)), Matthew Feickert (University of Wisconsin Madison (US))

14:00 CWL in the HPC ecosystem

Speaker: Iacopo Colonnelli (Universita e INFN Torino (IT))

CWL4HPC.pdf

14:50 Airflow and Nextflow Overview

Speaker: Erik Johnson (Radiation Monitoring Devices)

apl_cern_talk_v1.pdf

15:40 Airflow Overview

Speaker: Ms Santona Tuli (University of California Davis (US))

16:10 Coffee Break

16:30 Discussion and Demos

• Have a focus on discussion around th technology choices and possible benefits
• Focus on having demonstration time with the developers on infrastructure we have available (IRIS-HEP cluster and CERN)

Speakers: Lukas Alexander Heinrich (Technische Universitat Munchen (DE)), Matthew Feickert (University of Wisconsin Madison (US))

Thursday 4 April

10:00 → 12:10 Session

Conveners: Clemens Lange (Paul Scherrer Institute (CH)), Jamie Gooding (Technische Universitaet Dortmund (DE))

10:00 Session Overview

Speakers: Clemens Lange (Paul Scherrer Institute (CH)), Jamie Gooding (Technische Universitaet Dortmund (DE))

20240404_Workflows_Intro.pdf

10:10 RECAST workflows in ATLAS SUSY

Speaker: Ben Hodkinson (University of Oxford (GB))

RECAST in ATLAS

RECAST in ATLAS.pdf

10:50 Snakemake Workflows in LHCb

Speakers: Mindaugas Sarpis (University of Manchester (GB)), Valeriia Lukashenko (University of Zurich (CH))

dag.pdf

M_Sarpis_LHCb_Analysis_with_Snakemake.pdf

rulegraph.pdf

Snakemake_part1.pdf

14:00 → 18:00 Session

Conveners: Clemens Lange (Paul Scherrer Institute (CH)), Jamie Gooding (Technische Universitaet Dortmund (DE))

14:00 Luigi/Law Workflows in CMS

Speaker: Marcel Rieger (Hamburg University (DE))

2024-04-04_law_wfws.pdf

14:40 HEP-CCE

Speaker: Dr Charles Leggett (Lawrence Berkeley National Lab (US))

FAIROS Workflows Workshop HEP-CCE Portable Applications and Workflows.pdf

15:10 Coffee Break

Speaker: Matthew Feickert (University of Wisconsin Madison (US))

15:30 FAST-HEP: Confronting the Challenges of Developing a Workflow Language for HEP Analysis

Speaker: Dr Luke Kreczko (University of Bristol (GB))

2024.04.04 - Workflow Languages Workshop - Why is it so hard to make a workflow language for HEP analysis_.pdf

slides

16:00 Discussion and Demos

• focus on physics application discussion
• feedback from the workflow dev side
• iteration discussion

Speakers: Clemens Lange (Paul Scherrer Institute (CH)), Jamie Gooding (Technische Universitaet Dortmund (DE))

19:00 → 21:00 Workshop Dinner

Conveners: Clemens Lange (Paul Scherrer Institute (CH)), Matthew Feickert (University of Wisconsin Madison (US))

Friday 5 April

10:00 → 12:00 Session

Conveners: Clemens Lange (Paul Scherrer Institute (CH)), Matthew Feickert (University of Wisconsin Madison (US))

10:00 Session Overview

Speaker: Clemens Lange (Paul Scherrer Institute (CH))

2024-04-05_workflows_Intro.pdf

10:10 REANA Overview and Demo

Speaker: Tibor Simko (CERN)

reana-workflow-language-workshop-20240405.pdf

11:00 REANA for IRIS-HEP AGC

Speaker: Andrii Povsten (Princeton University (US))

REANA for IRIS-HEP AGC.pdf

14:00 → 17:40 Session

Conveners: Jamie Gooding (Technische Universitaet Dortmund (DE)), Lukas Alexander Heinrich (Technische Universitat Munchen (DE))

14:00 Discussion: Workflow Adoption Roadmaps

Speakers: Clemens Lange (Paul Scherrer Institute (CH)), Jamie Gooding (Technische Universitaet Dortmund (DE)), Lukas Alexander Heinrich (Technische Universitat Munchen (DE)), Matthew Feickert (University of Wisconsin Madison (US))

14:40 Discussion: Workflow Adoption Challenges

Speakers: Clemens Lange (Paul Scherrer Institute (CH)), Jamie Gooding (Technische Universitaet Dortmund (DE)), Lukas Alexander Heinrich (Technische Universitat Munchen (DE)), Matthew Feickert (University of Wisconsin Madison (US))

15:20 Coffee Break

Speaker: Matthew Feickert (University of Wisconsin Madison (US))

15:40 Discussion and Document Writing

Speakers: Clemens Lange (Paul Scherrer Institute (CH)), Jamie Gooding (Technische Universitaet Dortmund (DE)), Lukas Alexander Heinrich (Technische Universitat Munchen (DE)), Matthew Feickert (University of Wisconsin Madison (US))