28-30 January 2019
Europe/Zurich timezone

Designing and Implementing for Scale, Distribution & Async

Jan 30, 2019, 9:15 AM


National Research Council - Piazzale Aldo Moro 7, 00185 Roma, Italy
Presentation Synchronization/Sharing Technology & Research Sync/share Technology&Research


Jörn Dreyer (ownCloud GmbH)


ownCloud has traditionally used the database to store metadata including the file hierarchy, shares, comments and tags.
Keeping this database metadata in sync with the actual filesystem becomes challenging when requests time out or fail for other reasons such as stale locks, partially traversed trees, or changes on storages that are not propagated, ultimately leading to filecache corruptions.
In order to power the next generation of storage services, we're rewriting the fundamental layers that ownCloud was built on using seven years of experience and combining it with the latest developments in technology.
A new event driven storage architecture makes background processing a first class citizen, allows storing all metadata in the storage, brings commands and queries to replace the synchronous nature of request processing, and an asynchronous protocol opens up new possibilities for distributed storages, federation and client communication.

Primary authors

Jörn Dreyer (ownCloud GmbH) Tom Needham (ownCloud)

Presentation materials