Speaker
Description
Modern high energy physics experiments and similar compute intensive fields are pushing the limits of dedicated grid and cloud infrastructure. In the past years research into augmenting this dedicated infrastructure by integrating opportunistic resources, i.e. compute resources temporarily acquired from third party resource providers, has yielded various strategies to approach this challenge. However, work on this topic is usually driven by practical needs to use specific resource providers for production workflows; in this context, research is ad hoc and relies on impressions gained during unique situations of resource providers, resource demand and opportunistic resource management. Replicating or even preparing a specific situation to investigate opportunistic resource management is extremely challenging or even impossible. More importantly research in the field of opportunistic resource management is therefore extremely limited.
We propose to tackle this challenge using simulation and to this end present the simulation framework LAPIS, a general purpose scheduling simulator offering programmatic control of resources. We demonstrate this approach by integrating LAPIS with the COBalD/TARDIS resource manager to investigate the behaviour of this resource manager in a simulated environment.
Significance
Our work is integral for advancing opportunistic resource management in a principled way. To our knowledge, this is the first successful attempt to run a production resource manager in a completely simulated environment.
References
"Transparent Integration of Opportunistic Resources into the WLCG Compute Infrastructure" Böhler, M.; Caspart, R.; Fischer, M.; Freyermuth, O.; Giffels, M.; Kroboth, S.; Kuehn, E.; Schnepf, M.; Cube, F. von; Wienemann, P. 2021. The European physical journal / Web of Conferences, 251, Art.-Nr.: 02039. doi:10.1051/epjconf/202125102039
"Effective Dynamic Integration and Utilization of Heterogenous Compute Resources" Fischer, M.; Giffels, M.; Heiss, A.; Kuehn, E.; Schnepf, M.; Cube, R. F. von; Petzold, A.; Quast, G. 2020. The European physical journal / Web of Conferences, 245, Article no: 07038. doi:10.1051/epjconf/202024507038
