9–13 Jul 2018
Sofia, Bulgaria
Europe/Sofia timezone

Serverless endpoint with public container clusters for HEP experiments

11 Jul 2018, 12:30
15m
Hall 10 (National Palace of Culture)

Hall 10

National Palace of Culture

presentation Track 7 – Clouds, virtualization and containers T7 - Clouds, virtualization and containers

Speaker

Rafal Grzymkowski (IFJ PAN)

Description

In recent years, public clouds have undergone a large transformation. Nowadays, cloud providers compete in delivery specialized scalable and fault tolerant services where resource management is completely on their side. Such computing model called serverless computing is very attractive for users who do not want to worry about OS level management, security patches and scaling resources.
Our aim was to build a batch computing solution based on serverless model enriched in traditional Grid computing endpoint features, like X509 certificate authorization and job scheduler. As the jobs processing ground we are using Docker container clusters orchestrated by AWS Batch service and AWS Lambda functions to handle REST API requests. API definition will be public available, so the proposed solution, initially for the Belle II, can be used by any HEP experiment.

Primary author

Co-author

Mr Mateusz Sułek (Institute of Nuclear Physics PAN)

Presentation materials