19–25 Oct 2024
Europe/Zurich timezone

Fair Universe HiggsML Uncertainty Challenge

21 Oct 2024, 13:48
18m
Large Hall B

Large Hall B

Talk Track 5 - Simulation and analysis tools Parallel (Track 5)

Speaker

Yulei Zhang (University of Washington (US))

Description

The Fair Universe project is organising the HiggsML Uncertainty Challenge, which will/has run from June to October 2024.

This HEP and Machine Learning competition is the first to strongly emphasise uncertainties: mastering uncertainties in the input training dataset and outputting credible confidence intervals.

The context is the measurement of the Higgs to tau+ tau- cross section like in HiggsML challenge on Kaggle in 2014, from a dataset of the 4-momentum signal state. Participants should design an advanced analysis technique that can not only measure the signal strength but also provide a confidence interval, from which correct coverage will be evaluated automatically from pseudo-experiments.

The confidence interval should include statistical and systematic uncertainties (concerning detector calibration, background levels, etc…). It is expected that advanced analysis techniques that can control the impact of systematics will perform best, thereby pushing the field of uncertainty-aware AI techniques for HEP and beyond.

The challenge is hosted on Codabench (an evolution of the popular Codalab platform); the significant resources needed (to run the thousands of pseudo-experiments needed) are possible thanks to using NERSC infrastructure as a backend.

The competition will have ended just before CHEP 2024 so that a first glimpse of the competition results could be made public for the first time.

Primary authors

Aishik Ghosh (University of California Irvine (US)) Ben Nachman (Lawrence Berkeley National Lab. (US)) Christopher Harris (Unknown) David Rousseau (IJCLab-Orsay) Ihsan Ullah (Chalearn) Isabelle Guyon Paolo Calafiura (Lawrence Berkeley National Lab. (US)) Peter Nugent (Berkeley) Ragansu Chakkappai (IJCLab-Orsay) Sascha Diefenbacher (Lawrence Berkeley National Lab. (US)) Shih-Chieh Hsu (University of Washington Seattle (US)) Steven Farrell (Lawrence Berkeley National Laboratory) Wahid Bhimji Yuan-Tang Chou (University of Washington (US)) Yulei Zhang (University of Washington (US))

Presentation materials