Analysis Ecosystem Workshop II
Auditorium Joliot Curie
IJCLab
As part of the search for Beyond the Standard Model physics, an array of next generation particle, nuclear and astroparticle experiments are under construction by global collaborations worldwide. These include the High-Luminosity Large Hadron Collider (HL-LHC) at CERN, the Deep Underground Neutrino Experiment (DUNE) at Fermilab, the Electron Ion Collider (EIC) at Brookhaven National Laboratory, the Facility for Antiproton and Ion Research at GSI, and many others.
These experiments are massive data generators and the cutting edge data science challenges are significant. For example, the HL-LHC experiments are expected to produce exabytes of science data each year. Discoveries require analyzing these huge data volumes and understanding extremely complex instruments, with ever more sophisticated algorithms. The development of highly performant data analysis systems that reduce "time-to-insight" and maximize physics potential is crucial. This involves the continued innovation by existing community tools like ROOT, new cutting-edge data science tools, the development of dedicated analysis facilities, advanced machine learning and entirely new routes to explore, such as differentiable programming.
It has been five years since the first Analysis Ecosystems Workshop organised by the HSF in 2017. Since that time many changes have happened, with the advent of new projects, tools, and data formats, intense activity and progress in established projects. Still, the challenge of efficient analysis for the HL-LHC era is not yet solved and so the HSF and IRIS-HEP, together with IJCLab, are organising the Second Analysis Ecosystems Workshop.
Topics for the workshop will include, amongst others:
- Analysis Facilities
- ML tools and differentiable computing workflows
- “Real-time” trigger-level analysis
- Analysis User Experience and Declarative Languages
- Analysis on reduced formats or specialist inputs
- Bookkeeping and systematics handling
As a workshop, there will be limited presentations, lots of time for discussion and a written outcome that summarises the workshop’s conclusions and points the way forward.
Organisers:
- Alexander Held
- Allison Reinsvold Hall
- Eduardo Rodrigues
- Elizabeth Sexton-Kennedy
- Giulio Eulisse
- Gordon Watts
- Graeme A Stewart
- Jana Schaarschmidt
- Jim Pivarski
- Jonas Rembser
- Loukas Gouskos
- Lukas Heinrich
- Michel Jouvin
- Mike Sokoloff
- Nathan Simpson
- Nicole Skidmore
- Oksana Shadura
- Paul Laycock
- Pere Mato Vila
- Peter Elmer
- Stephan Hageboeck
- Teng Jian Koo
-
-
08:45
→
09:00
Pickup badges and lunch tickets 15m Auditorium Joliot Curie
Auditorium Joliot Curie
IJCLab
Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area) -
09:00
→
10:30
Plenary Auditorium Joliot Curie
Auditorium Joliot Curie
IJCLab
Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)-
09:00
Welcome 15mSpeakers: Michel Jouvin (Université Paris-Saclay (FR)), Valerie Chambert (Universite de Paris-Sud 11 (FR)), Valérie Chambert (IPN Orsay/IN2P3/CNRS)
- 09:15
-
09:45
New Advances in Analysis Facilities 15mSpeaker: Robert Gardner (University of Chicago)
-
10:00
Analysis frameworks and Analysis Facilities: user experience 15mSpeaker: Nick Smith (Fermi National Accelerator Lab. (US))
-
10:15
Impact on Analysis Facilities in the context of DOMA evolution 15mSpeaker: Alessandra Forti (University of Manchester (GB))
-
09:00
-
10:30
→
11:00
Coffee Break 30m Espace Joliot Curie
Espace Joliot Curie
IJCLab
-
11:00
→
12:30
Plenary Auditorium Joliot Curie
Auditorium Joliot Curie
IJCLab
Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)-
11:00
Data Analysis Metadata Review 20mSpeaker: Thomas Kuhr (Ludwig Maximilians Universitat (DE))
-
11:20
Big Questions in Systematics Processing 20mSpeaker: Stephan Hageboeck (CERN)
-
11:40
ML Tooling and Use Landscape in HEP 20mSpeaker: Sean Joseph Gasiorowski (SLAC National Accelerator Laboratory (US))
-
12:00
Differentiable Programming in HEP 20mSpeaker: Lukas Alexander Heinrich (CERN)
-
12:20
Extra Discussion 10m
-
11:00
-
12:30
→
14:00
Lunch 1h 30m Cantine
Cantine
IJCLab
Building 230 -
14:00
→
16:30
Analysis Facilities Auditorium Joliot Curie
Auditorium Joliot Curie
IJCLab
Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)- 14:00
-
14:10
AFs in CMS 7mSpeaker: Lindsey Gray (Fermi National Accelerator Lab. (US))
-
14:20
AFs in ATLAS 7mSpeakers: Alessandra Forti (University of Manchester (GB)), Lukas Alexander Heinrich (CERN)
-
14:30
AFs in LHCb 7mSpeaker: Dr Nicole Skidmore (University of Manchester)
-
14:40
Discussion "Bridging analysis frameworks stakeholders and resource providers for future analysis HL-LHC facilities" 1h 20m
- Integrating different types of resources/”aaS” available on demand: public and private clouds, and Kubernetes (k8s): what is the best “recipe” for AF?
- "How to marry interactivity with distributed computation?" aspects related to e.g. UI design, resource management policies and debugging tools.
- Analysis containerization, feedback from point of view of users, AF architects, resource providers
- Idea of “dream” Analysis Facility, metrics and evaluation of successful AF characteristics
Speakers: Nicole Skidmore (University of Manchester), Oksana Shadura (University of Nebraska Lincoln (US))
-
14:00
→
16:30
ML and Autodiff Workflows 200-1-101
200-1-101
IJCLab
-
14:00
Intro 10mSpeakers: Lukas Alexander Heinrich (CERN), Nathan Daniel Simpson (Lund University (SE))
- 14:10
-
14:30
Differentiable Design Optimization 20mSpeaker: Giles Chatham Strong (Universita e INFN, Padova (IT))
-
14:50
Discussion 40mSpeakers: Lukas Alexander Heinrich (CERN), Nathan Daniel Simpson (Lund University (SE))
-
15:30
AD beyond Python and ML 30mSpeaker: Vassil Vasilev (Princeton University (US))
-
14:00
-
14:00
→
16:30
Metadata and Systematics 100-0-A018
100-0-A018
IJCLab
-
14:00
Metadata paper: Discussion of next steps 1hSpeaker: Paul James Laycock (Brookhaven National Laboratory (US))
-
15:00
What analysers want: Infrastructure for systematic variations 20mSpeaker: Enrico Guiraud (EP-SFT, CERN)
-
15:20
Systematics discussion 40m
-
14:00
-
16:30
→
17:00
Coffee 30m Auditorium Joliot Curie
Auditorium Joliot Curie
IJCLab
Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area) -
17:00
→
18:00
Plenary Auditorium Joliot Curie
Auditorium Joliot Curie
IJCLab
Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)-
17:00
ROOT User Workshop Summary 20mSpeaker: Axel Naumann (CERN)
-
17:20
Analysis user experience with the Python HEP ecosystem 20mSpeakers: Jim Pivarski (Princeton University), Matthew Feickert (Univ. Illinois at Urbana Champaign (US))
-
17:40
Declarative Languages Overview 20mSpeaker: Sezen Sekmen (Kyungpook National University (KR))
-
17:00
-
08:45
→
09:00
-
-
08:58
→
09:00
News of the Day 2m Auditorium Joliot Curie
Auditorium Joliot Curie
IJCLab
Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area) -
09:00
→
10:20
Plenary Auditorium Joliot Curie
Auditorium Joliot Curie
IJCLab
Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)-
09:00
Reduced Formats in ATLAS 15mSpeaker: James Catmore (University of Oslo (NO))
-
09:20
Reduced Formats in CMS 15mSpeaker: Lindsey Gray (Fermi National Accelerator Lab. (US))
-
09:40
Reduced Formats in Belle II 15mSpeaker: Michel Hernandez Villanueva (DESY)
-
10:00
Real-Time and Trigger Analysis Overview 20mSpeakers: Caterina Doglioni (University of Manchester (GB)), Michael David Sokoloff (University of Cincinnati (US))
-
09:00
-
10:20
→
10:25
Group Photo 5m Auditorium Joliot Curie
Auditorium Joliot Curie
IJCLab
Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area) -
10:25
→
10:50
Coffee 25m Espace Joliot Curie
Espace Joliot Curie
IJCLab
-
10:50
→
12:40
Analysis User Experience and Declarative Languages Auditorium Joliot Curie
Auditorium Joliot Curie
IJCLab
Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)-
10:50
Documentation, examples, benchmarking, interoperability 55m
4 aspects of documentation: https://documentation.divio.com/
interoperability examples:
- histograms: Josh's ROOT workshop talk https://indico.fnal.gov/event/23628/contributions/237985/
- RDataFrame / awkward: Ianna's ROOT workshop talk https://indico.fnal.gov/event/23628/contributions/240305/
- statistical models: RooFit, zfit, pyhf, ... -
11:45
Additional topics & follow-up from previous day 55m
lessons to be learned from Julia,
future of ADL,
...
-
10:50
-
10:50
→
12:40
Reduced Formats 100-0-Salle des Conseils
100-0-Salle des Conseils
IJCLab
-
10:50
Reduced formats for long lived particles in ATLAS 15mSpeaker: Jackson Carl Burzynski (Simon Fraser University (CA))
-
11:20
Limitations of NanoAOD and possible solutions 15mSpeaker: Bryan Cardwell (University of Virginia (US))
-
11:50
Augmenting PHYSLITE content for sub set of events in ATLAS 15mSpeaker: Lukas Alexander Heinrich (CERN)
-
12:20
Object Store R&D 15mSpeaker: Nick Smith (Fermi National Accelerator Lab. (US))
-
10:50
-
12:40
→
14:30
Lunch 1h 50m Cantine
Cantine
IJCLab
Building 230 -
14:30
→
16:00
Crossover Sessions: Analysis Facilities & AI and Autodiff & UX and Declarative Languages Auditorium Joliot Curie
Auditorium Joliot Curie
IJCLab
Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area) -
16:00
→
16:30
Coffee 30m Espace Joliot Curie
Espace Joliot Curie
IJCLab
-
16:30
→
18:00
BoFs and Breakouts: Let’s Define the Steps of an Analysis Workflow 100-0-A018
100-0-A018
IJCLab
Convener: Benjamin Galewsky (Univ. Illinois at Urbana Champaign (US))-
16:30
Discussion: Let’s Define the Steps of an Analysis Workflow 1h 30mSpeaker: Benjamin Galewsky (Univ. Illinois at Urbana Champaign (US))
-
16:30
-
16:30
→
18:00
Crossover Sessions: Reduced Formats & Bookkeeping and Systematics 100-0-Salle des Conseils
100-0-Salle des Conseils
IJCLab
-
16:30
→
18:00
Real-Time and Trigger Analysis Auditorium Joliot Curie
Auditorium Joliot Curie
IJCLab
Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)-
16:30
LHCb HLT1 Monitoring 20mSpeaker: Daniel Charles Craik (Massachusetts Inst. of Technology (US))
-
16:50
Discussion 1h 10m
-
16:30
-
19:30
→
22:00
Workshop Dinner 2h 30m
https://bouillonracine.fr/en/home/
-
08:58
→
09:00
-
-
09:00
→
10:30
Continuing Discussions Auditorium Joliot Curie
Auditorium Joliot Curie
IJCLab
Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)To help the workshop converge on conclusions and next steps for the HEP analysis ecosystem, we have continuing discussions on Wednesday morning
-
09:00
News of the Day and DIscussion Planning 10m Auditorium Joliot Curie
Auditorium Joliot Curie
IJCLab
Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)Speaker: Dr Graeme A Stewart (CERN) -
09:10
Further Topic Discussion Time 1h 20m Various Rooms in B100
Various Rooms in B100
IJCLab
-
09:00
-
10:30
→
11:00
Coffee 30m Espace Joliot Curie
Espace Joliot Curie
IJCLab
-
11:00
→
12:30
Plenary: Summaries Auditorium Joliot Curie
Auditorium Joliot Curie
IJCLab
Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)-
11:00
Analysis Facilities 10mSpeakers: Nicole Skidmore (University of Manchester), Oksana Shadura (University of Nebraska Lincoln (US))
-
11:10
ML tools and differentiable computing workflows 10mSpeakers: Lukas Alexander Heinrich (CERN), Nathan Daniel Simpson (Lund University (SE))
-
11:20
“Real-time” online/trigger-level analysis 10mSpeakers: Giulio Eulisse (CERN), Michael David Sokoloff (University of Cincinnati (US))
-
11:30
Analysis User Experience and Declarative Languages 10mSpeakers: Alexander Held (New York University (US)), Jonas Rembser (CERN)
-
11:40
Analysis on reduced formats or specialist inputs 10mSpeakers: Allison Reinsvold Hall (Fermilab), Jana Schaarschmidt (University of Washington (US)), Loukas Gouskos (CERN)
-
11:50
Bookkeeping and systematics handling 10mSpeakers: Paul James Laycock (Brookhaven National Laboratory (US)), Teng Jian Khoo (Humboldt University of Berlin (DE))
-
12:00
Let's Define an Analysis Workflow 10mSpeaker: Benjamin Galewsky (Univ. Illinois at Urbana Champaign (US))
-
12:10
Discussion 15m
-
12:25
Closing Words 5mSpeaker: Gordon Watts (University of Washington (US))
-
11:00
-
12:30
→
14:20
Lunch 1h 50m Cantine
Cantine
IJCLab
Building 230 -
14:20
→
15:30
Report Writing
-
15:30
→
16:00
Coffee 30m Espace Joliot Curie (CERN)
Espace Joliot Curie
CERN
-
16:00
→
17:00
Report Writing
-
09:00
→
10:30