HEPiX Autumn 2020 online Workshop

Session

Computing and Batch Services

13 Oct 2020, 11:20

Online Workshop

50. Operating a production HTCondor cluster: Seamlessly automating maintenance, OS and HTCondor updates with (almost) zero downtimes

Dr Oliver Freyermuth (University of Bonn (DE))

13/10/2020, 11:20

Computing & Batch Services

Our HTC cluster using HTCondor has been set up at Bonn University in 2017/2018.
All infrastructure is fully puppetised, including the HTCondor configuration.

OS updates are fully automated, and necessary reboots for security patches are scheduled in a staggered fashion backfilling all draining nodes with short jobs to maximize throughput.
Additionally, draining can also be scheduled for...

24. Learning-based Approaches to Estimate Job Wait Time in HTC Datacenters

Mr Frederic Suter (CC-IN2P3 / CNRS)

13/10/2020, 11:40

Computing & Batch Services

High Throughput Computing (HTC) datacenters are a cornerstone of scientific discoveries in the fields of High Energy Physics and Astroparticles Physics. These datacenters provide thousands of users from dozens scientific collaborations with tens of thousands computing cores and Petabytes of storage. The scheduling algorithm used in such datacenters to handle the millions of (mostly...