Fair Universe HiggsML Uncertainty CERN workshop

Monday 19 May 2025, 09:00 → 13:00 Europe/Zurich

222/R-001 "Filtration Plant" (CERN)

The FAIR Universe -- HiggsML Uncertainty Challenge focuses on measuring the physics properties of elementary particles with imperfect simulators.

The goal of the challenge is to bring together the physics and machine learning communities to advance our understanding and methodologies in handling systematic (epistemic) uncertainties within AI techniques.

The challenge (an official NeurIPS 2024 competition) has run 1st October 2024 till 15th March 2025, and the dataset and benchmark will remain available to evaluate further developments.

Results have just been announced !

After extensive studies on a new hold-out data set, the Vienna HEPHY team and Ibrahim Elsharkawy (U Illinois at Urbana Champaign) cannot be separated in a significant way and are declared joint first. Hashizume Yota (Kyoto University) has secured third position. 

This event is the closing workshop where the three best participants will present their solutions, as well as keynotes addressing the overall topic of uncertainty-aware training.

It is run as a satellite workshop for the 7th CERN Interexperiment Machine Learning workshop. We recommend participants to Fair Universe workshop to register here and also  for the main free IML workshop, in particular for anything concerning CERN access and accommodation

Useful links:

• Fair Universe web site and winner announcement
• Fair Universe HiggsML uncertainties competition site
• NeurIPS 2024 Fair universe workshop
• Fair universe whitepaper

 

This is a collaboration between LBNL Berkeley, University of Washington, Chalearn and University Paris-Saclay: Wahid Bhimji, Paolo Calafiura, Ragansu Chakkappai, Po-Wen Chang, Yuan-Tang Chou, Sascha Diefenbacher, Jordan Dudley, Steven Farrell, Aishik Ghosh, Isabelle Guyon, Chris Harris, Shih-Chieh Hsu, Elham E Khoda, Benjamin Nachman, Peter Nugent, David Rousseau, Benjamin Sluijter, Benjamin Thorne, Ihsan Ullah and Yulei Zhang.

09:00 → 09:30 Uncertainties in ML for HEP

Speaker: Michael Kagan (SLAC National Accelerator Laboratory (US))

09:30 → 10:00 Systematic uncertainty-aware neural network trainings for binned-likelihood analyses at the LHC

Speaker: Roger Wolf (KIT - Karlsruhe Institute of Technology (DE))

10:00 → 10:30 Coffee break

10:30 → 11:00 Fair Universe HiggML uncertainty competition overview and results

11:00 → 11:25 Gold medal tie talk : HEPHY

Speaker: Robert Schoefbeck (Hephy Vienna)

11:25 → 11:50 Gold medal tie talk : IBRAHIME

Speaker: Ibrahim Elsharkawy (University of Illinois Urbana-Champaign)

11:50 → 12:05 Bronze medal talk : HZUME

Speaker: Hashizume Yota (Kyoto University)

12:05 → 12:15 Fair Universe HIggsML uncertainty permanent release and benchmark