9–10 Jun 2015
CERN
Europe/Zurich timezone
There is a live webcast for this event.

Data Storage Institute: Speeding-up large-scale storage with non-volatile memory

10 Jun 2015, 10:40
15m
500/1-001 - Main Auditorium (CERN)

500/1-001 - Main Auditorium

CERN

400
Show room on map

Speakers

Khai Leong Yong (DSI) Sergio Ruocco (DSI)

Description

CERN EOS distributed, scalable, fault-tolerant filesystem serves data to 100s-1000s of clients. To speed-up the service, it keeps and updates a large and fast data Catalog in RAM that can reach a footprint of 100+ GBs. When a EOS server node crashes the Master node must rebuild a new coherent Catalog in memory from disk logs, a long operation that disrupts the activity of the clients. We propose to design a persistent, version of the EOS Catalog to be stored in the new Non-Volatile Memory that will remain consistent after faults. Upon restart, the EOS server process will find the Catalog in NVM and immediately resume serving all the clients, skipping the slow reconstructions from disk-based logs altogether.

Presentation materials