Framework for Hyperparameter Optimization in Machine Learning using the ATLAS Grid Computing Resource

12 Jul 2021, 16:15
15m
Track E (Zoom)

Track E

Zoom

talk Computation, Machine Learning, and AI Computation, Machine Learning, and AI

Speaker

Alkaid Cheng (University of Wisconsin Madison (US))

Description

Application of machine learning methods in high energy physics has received tremendous success in recent years with rapidly growing use cases. A key aspect in improving the performance of a given machine learning model has been the optimization of its hyperparameters which is usually computationally expensive. A framework has been developed to provide a high-level interface for automatic hyperparameter optimization that utilizes the ATLAS grid computing resource with hardware acceleration from GPU machines. The framework is equipped with a wide variety of hyperparameter optimization algorithms, distributed optimization schemes, intelligent job scheduling strategy based on available resources, flexible hyperparameter configuration space generation, and adaptation to the ATLAS intelligent Data Delivery Service. An example use case for the hyperparameter optimization of a Boosted Decision Tree model in the $HH \to b\bar{b}\gamma\gamma$ non-resonant analysis in $pp$ collisions at $\sqrt{s}=$ 13 TeV with the ATLAS detector is also presented.

Are you are a member of the APS Division of Particles and Fields? No

Primary author

Alkaid Cheng (University of Wisconsin Madison (US))

Presentation materials