28–30 Jan 2019
CNR
Europe/Zurich timezone

A journey to the mesh : microservices-based sync and share using gRPC and Protobuf

30 Jan 2019, 09:55
20m
CNR

CNR

National Research Council - Piazzale Aldo Moro 7, 00185 Roma, Italy
Presentation Synchronization/Sharing Technology & Research Sync/share Technology&Research

Speaker

Hugo Gonzalez Labrador (CERN)

Description

CERNBox is a multipetabyte-scale sync and share platform at CERN, storing close to 7 PB of data for more than 16K users. Over time we have identified different improvement points to increase development agility and maintenance costs for running the service. Last year we have evolved the architecture of the service from a monolithic stack to a decentralised model based on micro-services. This mesh is the core of the new system and relies on latest technologies (gRPC and Protobuf) for efficient inter-component communication and controlled API evolution. In this talk we present the process we followed and our observations during this journey, which led to the creation of the public consumable CS3 APIs for a distributed sync and share platform.

Primary author

Hugo Gonzalez Labrador (CERN)

Presentation materials