4-7 September 2018
Europe/London timezone

Cloud scavenging with HTCondor in the EOSCpilot Fusion Science Demonstrator

6 Sep 2018, 11:30
CR12, R68 (RAL)

CR12, R68


Science and Technology Facilities Council Rutherford Appleton Laboratory Harwell Campus Didcot OX11 0QX United Kingdom Tel: +44 (0)1235 445 000 Fax: +44 (0)1235 445 808 N 51° 34' 27.6" W 1° 18' 52.6" (51.57433,-1.31462)
HTCondor presentations and tutorials Workshop presentations


Dr Andrew Lahiff (UKAEA)


Access to both HTC and HPC facilities is vitally important to the fusion community, not only for plasma modelling but also for advanced engineering and design, materials research, rendering, uncertainty quantification and advanced data analytics for engineering operations. The computing requirements are expected to increase as the community prepares for the next generation facility, ITER. Moving to a decentralised computing model is vital for future ITER analysis where no single site will have sufficient resource to run all necessary workflows.

PROMINENCE is one of the Science Demonstrators in the European Open Science Cloud for Research Pilot Project (EOSCpilot) and aims to demonstrate that the fusion community can make use of distributed cloud resources. Here we will describe our proof-of-concept system, leveraging HTCondor, which enables users to submit both HTC and HPC jobs using a simple command line interface or RESTful API and run them in containers across a variety of cloud sites, ranging from local cloud resources, EGI FedCloud sites through to public clouds.

Primary author

Dr Andrew Lahiff (UKAEA)

Presentation materials