2–3 Feb 2017
CERN
Europe/Zurich timezone

EOS at 6,500 Kilometres Wide

2 Feb 2017, 11:00
20m
31/3-004 - IT Amphitheatre (CERN)

31/3-004 - IT Amphitheatre

CERN

105
Show room on map

Speaker

Mr David Jericho (AARNet)

Description

Impressed by CERN’s EOS filesystem providing a POSIX-like capability on top of a tried and tested large scale storage system, AARNet runs multiple EOS clusters, the most interesting being a three site single namespace running replicas across 65ms. This filesystem is used for user data delivered via ownCloud, FileSender and an internally developed tool for fast parallel bundled uploads.

Currently the filesystem is 2 petabytes, split between Perth, Melbourne and Brisbane in Australia, and the current plans are to grow it well into the tens of petabytes within the next year.

AARNet has tried multiple scale out filesystems over the years in order to get true geographic replication and a single namespace across the Australian continent, but so far only EOS has had the capability of delivering within reasonable constaints.”

This talk will cover some of the first hand experiences with running, maintaining, and debugging issues found along the way.

Primary author

Mr David Jericho (AARNet)

Presentation materials