PyHEP 2019 Workshop

Oct 16, 2019, 9:00 AM → Oct 18, 2019, 4:00 PM Europe/London

Abingdon, U.K.

Benjamin Krikler (University of Bristol (GB)), Eduardo Rodrigues (University of Cincinnati (US))

The PyHEP workshops are a series of workshops initiated and supported by the HEP Software Foundation (HSF) with the aim to provide an environment to discuss and promote the usage of Python in the HEP community at large. Further information is given here.

PyHEP 2019 will be held at The Cosener's House, in Abingdon, near Oxford, United Kingdom, from 16-18 October 2019.

The workshop will be a forum for the participants and the community at large to discuss developments of Python packages and tools, exchange experiences, and steer where the community needs and wants to go. There will be ample time for discussion.

 

The agenda will be composed of plenary sessions, a highlight of which is the following:
1) A keynote presentation on the PyViz - open source visualization tools for Python - project, given by Philipp Rudiger, a member of the developers team.

2) Topical sessions on e.g. histogramming and statistics, including a talk and a hands-on tutorial.
3) Lightning talks from participants.
4) Presentations following up from topics discussed at PyHEP 2018.

 

Partial travel support for some U.S. participants (in particular, students and early-career postdocs) may be available from the IRIS-HEP institute. Please contact Peter Elmer (Peter.Elmer@cern.ch) to enquire about details.

 

Organising Committee

Eduardo Rodrigues - University of Cincinnati (Chair)
Ben Krikler - University of Bristol (Co-chair)

 

Sponsors

The event is kindly sponsored by

           

Live Notes

PyHEP2019_Participants.jpg

PyHEP2019_Participants_thumbnail.png

workshop_photos.zip

Wed, October 16

9:30 AM → 9:45 AM Welcome and workshop overview

Convener: Benjamin Krikler (University of Bristol (GB))

9:30 AM Welcome and workshop overview

Speaker: Eduardo Rodrigues (University of Cincinnati (US))

EduardoRodrigues_PyHEP2019_intro.pdf

9:45 AM → 10:45 AM Research software

Convener: Benjamin Krikler (University of Bristol (GB))

9:45 AM Overview of the SSI and reproducible research software

Speaker: Sam Mangham (Software Sustainability Institute, U.K.)

SamMangham-SSI-and-reproducible-research-software

slides-2019-10-16-pyhep.html

10:15 AM The Scikit-HEP project

Speaker: Eduardo Rodrigues (University of Cincinnati (US))

EduardoRodrigues_PyHEP2019_Scikit-HEP.pdf

10:45 AM → 11:15 AM Coffee/tea break

11:15 AM → 12:15 PM Packaging, distribution, CI

Convener: Dr Martin Ritter (LMU / Cluster Universe)

11:15 AM Packaging for Python and beyond

Speaker: Chris Burr (CERN)

2019-10-16_PyHEP2019-packaging.pdf

2019-10-16_PyHEP2019-packaging-with-setup-py-backup.pdf

11:45 AM scikit-validate - physics validation for small software projects

Speaker: Dr Lukasz Kreczko (University of Bristol (GB))

scikit-validate - PyHEP 2019.pdf

12:15 PM → 12:30 PM Workshop photo

12:30 PM → 2:00 PM Lunch

2:00 PM → 3:30 PM Accelerators-enabled code

Convener: Jim Pivarski (Princeton University)

2:00 PM GPU Computing via Python's Context Management for Beam Dynamics Simulations

Speaker: Adrian Oeftiger (GSI - Helmholtzzentrum fur Schwerionenforschung GmbH (DE))

oeftiger_gpus_in_python_animated.pdf

oeftiger_gpus_in_python_static.pdf

vid_no1.mp4

vid_no1.wmv

vid_no2.mp4

2:30 PM Introducing SixTrackLib: a versatile, hardware-accelerated single-particle tracking library

Speaker: Martin Schwinzerl (University of Graz (AT))

intro_sixtracklib_handouts.pdf

intro_sixtracklib.pdf

SixTrackLib @ github.com

3:00 PM hepaccelerate: data analysis with jagged arrays on GPUs

Speaker: Joosep Pata (California Institute of Technology (US))

2019_10_15_pyhep.pdf

3:30 PM → 4:00 PM Coffee/tea break

4:00 PM → 5:00 PM Lightning talks

Convener: Benjamin Krikler (University of Bristol (GB))

all_slides.pdf

1. Helena Malbouisson

2. Martha Hilton

3. Jim Pivarski

4. Hans Dembinski

5. Chris Burr

6. Igor Volobouev

7. Ben Krikler

8. Martin Schwinzerl

9. Joosep Pata

10. Lindsey Gray

11. Henry Schreiner

12. Pieter David

13. Luke Kreczko

14. Jonas Eschle

15. Gordon Watts

16. Brett Mayes

17. Mason Proffitt

18. Matthew Feickert

19. Miroslav Kubu

20. Henry Day-hall

5:00 PM → 6:00 PM HEP Python software ecosystem

Convener: Henry Fredrick Schreiner (Princeton University)

5:00 PM Readable and efficient HEP data analysis with bamboo

Speaker: Pieter David (Universite Catholique de Louvain (UCL) (BE))

Bamboo_PyHEP2019_PieterDavid.pdf

5:30 PM Particles and decays

Speaker: Eduardo Rodrigues (University of Cincinnati (US))

Notebook repository

ParticlesAndDecays.slides.html

7:00 PM → 8:00 PM Dinner

Thu, October 17

9:00 AM → 10:10 AM Visualisation

Convener: Benjamin Krikler (University of Bristol (GB))

9:00 AM Panel: Turn your existing Python analysis code into deployable dashboards

KEYNOTE PRESENTATION:

Over the last decade the Python scientific ecosystem have become an incredibly powerful toolkit for performing analyses and visualizing data. Once an analysis is done it often has to be shared with a wider audience, either within an organization or with the wider public, but this step often requires an entirely different set of tools and skillset. Panel is a new, open-source Python library built to easily wrap the outputs of an analysis, combine them with widgets and then lay them out as an interactive app or dashboard. This enables faster iteration cycles within organizations and ensures users without in-depth familiarity with web programming can develop and deploy complex dashboards with minimal code.

Panel natively supports a wide range of plotting tools and many other types of data making it trivial to work with the tools users are already familiar with. A complex interactive Panel-based dashboard is typically many times shorter than the equivalent Dash or Bokeh code, focusing on expressing relationships between widgets, computation, and visualizations directly. At the same time Panel is not limited to building simple apps and can be used to visualize complex, multi-stage analysis pipelines, provides full styling flexibility using CSS and Bokeh themes and has the ability to dynamically resize to the size of the browser window.

Once an application is built either in a Python script or notebook it can trivially be deployed as a standalone app using Bokeh Server without any change in behavior. Alternatively, Panel apps can be exported to static HTML files by defining Javascript based interactions or even recording and embedding the app's state space, making it possible to share interactive visualizations as self-contained files.

In the talk we will discover some of the core ideas behind Panel, go through the process of making an existing Jupyter notebook deployable as a dashboard and finally look at a number of case studies of real world dashboards analyzing large volumes of scientific data. With Panel, your analyses and visualizations can now very easily leap from your notebook or custom scripts into the real world!

Speaker: Philipp Rudiger (Anaconda)

Presentation repository

PyHEP2019_slides.pdf

9:40 AM mpl-hep - HEP needs for visualization

Speaker: Andrzej Novak (RWTH Aachen (DE))

PyHEP_2019_Andrzej.pdf

10:10 AM → 10:40 AM Coffee/tea break

10:40 AM → 11:40 AM Analysis platforms

Convener: Eduardo Rodrigues (University of Cincinnati (US))

10:40 AM SWAN

Speaker: Diogo Castro (CERN)

201910-swan-pyhep.pdf

11:10 AM Parsl live-coding session

Speaker: Ben Clifford

parsl-pi-estimation.html

parsl-pi-estimation.pdf

11:50 AM → 12:50 PM High-level Analysis Tools

Convener: Eduardo Rodrigues (University of Cincinnati (US))

11:50 AM Coffea

Speaker: Lindsey Gray (Fermi National Accelerator Lab. (US))

PyHEP_LindseyGray_17102019.pdf

12:20 PM F.A.S.T.

Speaker: Benjamin Krikler (University of Bristol (GB))

191016_ The FAST-HEP toolkit.pdf

12:50 PM → 2:30 PM Lunch

2:30 PM → 3:30 PM Analysis fundamentals

Convener: Benjamin Krikler (University of Bristol (GB))

2:30 PM Writing files with uproot

Speaker: Pratyush Das (Institute of Engineering and Management, Kolkata)

uproot-pyhep.pdf

3:00 PM Awkward 1.0

Speaker: Jim Pivarski (Princeton University)

pivarski-pyhep-awkward.pdf

3:30 PM → 4:00 PM Coffee/tea break

4:00 PM → 6:00 PM Histogramming & news on Python 3.8

Convener: Henry Fredrick Schreiner (Princeton University)

4:00 PM Aside: quick news on Python 3.8

Speaker: Henry Fredrick Schreiner (Princeton University)

python38.pdf

4:15 PM Python histogramming packages

Speaker: Henry Fredrick Schreiner (Princeton University)

histogramming.pdf

5:00 PM Hands-on

Speaker: Henry Fredrick Schreiner (Princeton University)

Workbook repo

7:00 PM → 8:00 PM Dinner

Fri, October 18

9:00 AM → 10:30 AM Statistics

Convener: Hans Peter Dembinski (Max-Planck-Institute for Nuclear Physics, Heidelberg)

9:00 AM zfit

Speaker: Jonas Eschle (Universitaet Zuerich (CH))

pyhep_zfit_Jonas_Eschle.pdf

zfit github

zfit tutorials

zfit: scalable pythonic fitting

zfit brings together the model fitting efforts for HEP in Python by defining an API & Workflow and an implementation on top of TensorFlow and scikit-hep packages.

It offers an extensive model building part, currently focused on unbinned likelihoods.

9:30 AM pyhf

Speaker: Matthew Feickert (Univ. Illinois at Urbana Champaign (US))

Feickert_pyhf-talk-export.pdf

GitHub repo hosting talk

pyhf talk

10:00 AM Fast likelihood analysis in more dimensions for Xenon TPCs

Speaker: Bart Pelssers (Stockholm University)

pyhep_talk.pdf

10:30 AM → 11:00 AM Coffee/tea break

11:00 AM → 12:30 PM Statistics

Convener: Eduardo Rodrigues (University of Cincinnati (US))

11:00 AM Introduction to iminuit

Speaker: Dr Hans Peter Dembinski (Max-Planck-Institute for Nuclear Physics, Heidelberg)

iminuit_intro.html

11:30 AM Statistical Methods in the NPStat Package

Speaker: Igor Volobouev (Texas Tech University (US))

install_npstat_with_prerequisites.csh

npstat.pdf

12:00 PM Computing coverage with NumPy and Numba of Bayesian and Frequentist intervals

Speaker: Hans Peter Dembinski (Max-Planck-Institute for Nuclear Physics, Heidelberg)

dembinski_coverage_numba.html

12:30 PM → 1:00 PM PyROOT

Convener: Benjamin Krikler (University of Bristol (GB))

12:30 PM PyROOT

Speaker: Massimiliano Galli

PyROOT_PyHEP_2019.pdf

1:00 PM → 1:05 PM Closeout

1:00 PM Workshop closeout

Speakers: Benjamin Krikler (University of Bristol (GB)), Eduardo Rodrigues (University of Cincinnati (US))

2019-10-18_PyHEP2019Abingdon-CloseOut.pdf

1:05 PM → 2:05 PM Lunch