Analysis Ecosystems Workshop II

Europe/Zurich
Auditorium Joliot Curie (IJCLab)

Auditorium Joliot Curie

IJCLab

Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)
Description

HSF LogoIRIS-HEP LogoIJCLab Logo

 

As part of the search for Beyond the Standard Model physics, an array of next generation particle, nuclear and astroparticle experiments are under construction by global collaborations worldwide. These include the High-Luminosity Large Hadron Collider (HL-LHC) at CERN, the Deep Underground Neutrino Experiment (DUNE) at Fermilab, the Electron Ion Collider (EIC) at Brookhaven National Laboratory, the Facility for Antiproton and Ion Research at GSI, and many others.

These experiments are massive data generators and the cutting edge data science challenges are significant. For example, the HL-LHC experiments are expected to produce exabytes of science data each year.  Discoveries require analyzing these huge data volumes and understanding extremely complex instruments, with ever more sophisticated algorithms.  The development of highly performant data analysis systems that reduce "time-to-insight" and maximize physics potential is crucial. This involves the continued innovation by existing community tools like ROOT, new cutting-edge data science tools, the development of dedicated analysis facilities, advanced machine learning and entirely new routes to explore, such as differentiable programming.

It has been five years since the first Analysis Ecosystems Workshop organised by the HSF in 2017. Since that time many changes have happened, with the advent of new projects, tools, and data formats, intense activity and progress in established projects. Still, the challenge of efficient analysis for the HL-LHC era is not yet solved and so the HSF and IRIS-HEP, together with IJCLab, are organising the Second Analysis Ecosystems Workshop.

Topics for the workshop will include, amongst others:

  • Analysis Facilities
  • ML tools and differentiable computing workflows
  • “Real-time” trigger-level analysis
  • Analysis User Experience and Declarative Languages
  • Analysis on reduced formats or specialist inputs
  • Bookkeeping and systematics handling

As a workshop, there will be limited presentations, lots of time for discussion and a written outcome that summarises the workshop’s conclusions and points the way forward.

Organisers:

  • Alexander Held
  • Allison Reinsvold Hall
  • Eduardo Rodrigues
  • Elizabeth Sexton-Kennedy
  • Giulio Eulisse
  • Gordon Watts
  • Graeme A Stewart
  • Jana Schaarschmidt
  • Jim Pivarski
  • Jonas Rembser
  • Loukas Gouskos
  • Lukas Heinrich
  • Michel Jouvin
  • Mike Sokoloff
  • Nathan Simpson
  • Nicole Skidmore
  • Oksana Shadura
  • Paul Laycock
  • Pere Mato Vila
  • Peter Elmer
  • Stephan Hageboeck
  • Teng Jian Koo

Workshop Photo

Participants
  • Ahmed Foda
  • Akram Khan
  • Alessandra Forti
  • Alexander Held
  • Alexei Klimentov
  • Allison Reinsvold Hall
  • Aman Desai
  • Aman Goel
  • Andrea Sciabà
  • Andrzej Novak
  • Anish Biswas
  • Antoine Perus
  • Antonio Delgado Peris
  • Antonio Perez-Calero Yzquierdo
  • Axel Naumann
  • Ayanabha Das
  • Baidyanath Kundu
  • Bartosz Sobol
  • Benjamin Galewsky
  • Brian Le
  • Bryan Cardwell
  • Caterina Doglioni
  • Christine Ploen
  • Conor Fitzpatrick
  • Daniel Charles Craik
  • David Chamont
  • David Jenkins
  • David Lange
  • David Martin Koch
  • David Rousseau
  • Dirk Duellmann
  • Doug Benjamin
  • Edmund Xiang Lin Ting
  • Eduardo Rodrigues
  • Efe Yazgan
  • Elizabeth Sexton-Kennedy
  • Engin Eren
  • Enric Tejedor Saavedra
  • Enrico Guiraud
  • Eric Christian Lancon
  • Eric Fede
  • Eric Grancher
  • Evangelos Kourlitis
  • Gagik Gavalian
  • Garima Singh
  • Giles Chatham Strong
  • Gokhan Unel
  • Gonzalo Merino Arevalo
  • Gordon Watts
  • Graeme A Stewart
  • Grigori Rybkin
  • Henry Fredrick Schreiner
  • Ianna Osborne
  • Jackson Carl Burzynski
  • Jakob Blomer
  • James Catmore
  • Jana Schaarschmidt
  • Janina Nicolini
  • Jay Ajitbhai Sandesara
  • Jaydip Singh
  • Jeremiah Juevesano
  • Jim Pivarski
  • Johannes Lange
  • Jonas Eschle
  • Jonas Rembser
  • Jose Flix Molina
  • Jose Hernandez
  • Julius Hrivnac
  • Kanhaiya Gupta
  • Kilian Lieret
  • Laurent Duflot
  • Lindsey Gray
  • Loukas Gouskos
  • Lukas Alexander Heinrich
  • Luke Kreczko
  • Mario Lassnig
  • Mark Waterlaat
  • Markus Schulz
  • Martin Børstad Eriksen
  • Mason Proffitt
  • Matteo Barbetti
  • Matthew Feickert
  • Miaoyuan Liu
  • Michael David Sokoloff
  • Michel Hernandez Villanueva
  • Michel Jouvin
  • Mohamed Aly
  • munera alrashed
  • Nathan Daniel Simpson
  • Nick Manganelli
  • Nick Smith
  • Nicole Skidmore
  • Nikolai Hartmann
  • Nils Erik Krumnack
  • Oksana Shadura
  • Patrick Koppenburg
  • Paul James Laycock
  • Pere Mato Vila
  • Peter Elmer
  • Philipp Windischhofer
  • Philippe Canal
  • Qichen Dong
  • Raul Rabadan
  • Remco de Boer
  • Robert William Gardner Jr
  • Sayanta Neogi
  • Sean Joseph Gasiorowski
  • Sezen Sekmen
  • Simone Campana
  • Snehankit Pattnaik
  • Stephan Hageboeck
  • Sviatoslav Bilokin
  • Swapnesh Khade
  • Tal van Daalen
  • Teng Jian Khoo
  • Thomas Kuhr
  • Thomas McCauley
  • Tibor Simko
  • Tomas Dado
  • Vassil Vasilev
  • Vrinda Vrinda
  • Waleed Esmail
  • Wouter Deconinck
  • Xuan Li
  • Zhiwen Zhao
    • 1
      Pickup badges and lunch tickets Auditorium Joliot Curie

      Auditorium Joliot Curie

      IJCLab

      Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)
    • Plenary Auditorium Joliot Curie

      Auditorium Joliot Curie

      IJCLab

      Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)
    • 10:30 AM
      Coffee Break Espace Joliot Curie

      Espace Joliot Curie

      IJCLab

    • Plenary Auditorium Joliot Curie

      Auditorium Joliot Curie

      IJCLab

      Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)
    • 12:30 PM
      Lunch Cantine

      Cantine

      IJCLab

      Building 230
    • Analysis Facilities Auditorium Joliot Curie

      Auditorium Joliot Curie

      IJCLab

      Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)
      • 12
        AFs in CERN
        Speaker: Enric Tejedor Saavedra (CERN)
      • 13
        AFs in CMS
        Speaker: Lindsey Gray (Fermi National Accelerator Lab. (US))
      • 14
        AFs in ATLAS
        Speakers: Alessandra Forti (University of Manchester (GB)), Lukas Alexander Heinrich (CERN)
      • 15
        AFs in LHCb
        Speaker: Dr Nicole Skidmore (University of Manchester)
      • 16
        Discussion "Bridging analysis frameworks stakeholders and resource providers for future analysis HL-LHC facilities"
        • Integrating different types of resources/”aaS” available on demand: public and private clouds, and Kubernetes (k8s): what is the best “recipe” for AF?
        • "How to marry interactivity with distributed computation?" aspects related to e.g. UI design, resource management policies and debugging tools.
        • Analysis containerization, feedback from point of view of users, AF architects, resource providers
        • Idea of “dream” Analysis Facility, metrics and evaluation of successful AF characteristics
        Speakers: Nicole Skidmore (University of Manchester), Oksana Shadura (University of Nebraska Lincoln (US))
    • ML and Autodiff Workflows 200-1-101

      200-1-101

      IJCLab

      Zoom Meeting ID
      64019607728
      Host
      Pere Mato Vila
      Alternative hosts
      Graeme A Stewart, Michel Jouvin
      Useful links
      Join via phone
      Zoom URL
    • Metadata and Systematics 100-0-A018

      100-0-A018

      IJCLab

      Zoom Meeting ID
      61636133973
      Host
      Paul James Laycock
      Alternative host
      Teng Jian Khoo
      Useful links
      Join via phone
      Zoom URL
    • 4:30 PM
      Coffee Auditorium Joliot Curie

      Auditorium Joliot Curie

      IJCLab

      Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)
    • Plenary Auditorium Joliot Curie

      Auditorium Joliot Curie

      IJCLab

      Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)
      • 25
        ROOT User Workshop Summary
        Speaker: Axel Naumann (CERN)
      • 26
        Analysis user experience with the Python HEP ecosystem
        Speakers: Jim Pivarski (Princeton University), Matthew Feickert (Univ. Illinois at Urbana Champaign (US))
      • 27
        Declarative Languages Overview
        Speaker: Sezen Sekmen (Kyungpook National University (KR))
    • 28
      News of the Day Auditorium Joliot Curie

      Auditorium Joliot Curie

      IJCLab

      Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)
    • Plenary Auditorium Joliot Curie

      Auditorium Joliot Curie

      IJCLab

      Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)
      • 29
        Reduced Formats in ATLAS
        Speaker: James Catmore (University of Oslo (NO))
      • 30
        Reduced Formats in CMS
        Speaker: Lindsey Gray (Fermi National Accelerator Lab. (US))
      • 31
        Reduced Formats in Belle II
        Speaker: Michel Hernandez Villanueva (DESY)
      • 32
        Real-Time and Trigger Analysis Overview
        Speakers: Caterina Doglioni (University of Manchester (GB)), Michael David Sokoloff (University of Cincinnati (US))
    • 33
      Group Photo Auditorium Joliot Curie

      Auditorium Joliot Curie

      IJCLab

      Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)
    • 10:25 AM
      Coffee Espace Joliot Curie

      Espace Joliot Curie

      IJCLab

    • Analysis User Experience and Declarative Languages Auditorium Joliot Curie

      Auditorium Joliot Curie

      IJCLab

      Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)
      • 34
        Documentation, examples, benchmarking, interoperability

        4 aspects of documentation: https://documentation.divio.com/

        interoperability examples:
        - histograms: Josh's ROOT workshop talk https://indico.fnal.gov/event/23628/contributions/237985/
        - RDataFrame / awkward: Ianna's ROOT workshop talk https://indico.fnal.gov/event/23628/contributions/240305/
        - statistical models: RooFit, zfit, pyhf, ...

      • 35
        Additional topics & follow-up from previous day

        lessons to be learned from Julia,
        future of ADL,
        ...

    • Reduced Formats 100-0-Salle des Conseils

      100-0-Salle des Conseils

      IJCLab

      Zoom Meeting ID
      64019607728
      Host
      Pere Mato Vila
      Alternative hosts
      Graeme A Stewart, Michel Jouvin
      Useful links
      Join via phone
      Zoom URL
    • 12:40 PM
      Lunch Cantine

      Cantine

      IJCLab

      Building 230
    • Crossover Sessions: Analysis Facilities & AI and Autodiff & UX and Declarative Languages Auditorium Joliot Curie

      Auditorium Joliot Curie

      IJCLab

      Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)
    • 4:00 PM
      Coffee Espace Joliot Curie

      Espace Joliot Curie

      IJCLab

    • BoFs and Breakouts: Let’s Define the Steps of an Analysis Workflow 100-0-A018

      100-0-A018

      IJCLab

      Convener: Benjamin Galewsky (Univ. Illinois at Urbana Champaign (US))
      • 40
        Discussion: Let’s Define the Steps of an Analysis Workflow
        Speaker: Benjamin Galewsky (Univ. Illinois at Urbana Champaign (US))
    • Crossover Sessions: Reduced Formats & Bookkeeping and Systematics 100-0-Salle des Conseils

      100-0-Salle des Conseils

      IJCLab

      Zoom Meeting ID
      61636133973
      Host
      Paul James Laycock
      Alternative host
      Teng Jian Khoo
      Useful links
      Join via phone
      Zoom URL
    • Real-Time and Trigger Analysis Auditorium Joliot Curie

      Auditorium Joliot Curie

      IJCLab

      Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)
    • 7:30 PM
      Workshop Dinner

      https://bouillonracine.fr/en/home/

    • Continuing Discussions Auditorium Joliot Curie

      Auditorium Joliot Curie

      IJCLab

      Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)

      To help the workshop converge on conclusions and next steps for the HEP analysis ecosystem, we have continuing discussions on Wednesday morning

      • 43
        News of the Day and DIscussion Planning Auditorium Joliot Curie

        Auditorium Joliot Curie

        IJCLab

        Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)
        Speaker: Dr Graeme A Stewart (CERN)
      • 44
        Further Topic Discussion Time Various Rooms in B100

        Various Rooms in B100

        IJCLab

    • 10:30 AM
      Coffee Espace Joliot Curie

      Espace Joliot Curie

      IJCLab

    • Plenary: Summaries Auditorium Joliot Curie

      Auditorium Joliot Curie

      IJCLab

      Laboratoire de Physique des 2 infinis Irène Joliot-Curie – IJCLab Building 100A 15 rue Georges Clémenceau, 91405 Orsay France (access to the auditorium is from the parking area)
      • 45
        Analysis Facilities
        Speakers: Nicole Skidmore (University of Manchester), Oksana Shadura (University of Nebraska Lincoln (US))
      • 46
        ML tools and differentiable computing workflows
        Speakers: Lukas Alexander Heinrich (CERN), Nathan Daniel Simpson (Lund University (SE))
      • 47
        “Real-time” online/trigger-level analysis
        Speakers: Giulio Eulisse (CERN), Michael David Sokoloff (University of Cincinnati (US))
      • 48
        Analysis User Experience and Declarative Languages
        Speakers: Alexander Held (New York University (US)), Jonas Rembser (CERN)
      • 49
        Analysis on reduced formats or specialist inputs
        Speakers: Allison Reinsvold Hall (Fermilab), Jana Schaarschmidt (University of Washington (US)), Loukas Gouskos (CERN)
      • 50
        Bookkeeping and systematics handling
        Speakers: Paul James Laycock (Brookhaven National Laboratory (US)), Teng Jian Khoo (Humboldt University of Berlin (DE))
      • 51
        Let's Define an Analysis Workflow
        Speaker: Benjamin Galewsky (Univ. Illinois at Urbana Champaign (US))
      • 52
        Discussion
      • 53
        Closing Words
        Speaker: Gordon Watts (University of Washington (US))
    • 12:30 PM
      Lunch Cantine

      Cantine

      IJCLab

      Building 230
    • Report Writing
    • 3:30 PM
      Coffee Espace Joliot Curie (CERN)

      Espace Joliot Curie

      CERN

    • Report Writing