24-27 September 2019
CERN
Europe/Zurich timezone

Persistent Memory based Key-Value Store for Data Acquisition Systems

25 Sep 2019, 15:45
30m
80/1-001 - Globe of Science and Innovation - 1st Floor (CERN)

80/1-001 - Globe of Science and Innovation - 1st Floor

CERN

300
Show room on map

Speaker

Maciej Maciejewski (Intel Corporation)

Description

Data acquisition (DAQ) systems are a key component for successful data taking in any experiment. The DAQ is a complex distributed computing system and coordinates all operations, from the data selection stage to long-term storage.
With increasing throughput demand, new ways to handle distributed data are being explored. One of the approaches is to use specialized Key-Value store, that would be able to handle data rates bound to network interfaces only (100-400 Gbps), while providing usage flexibility with specialized APIs designed for DAQ.
We shall present how combining new storage technologies based on Intel Optane DC Persistent Memory and NVMe drives, with specialized design of Key-Value store can help achieve throughput goals, and provide operational flexibility and safety.

Primary author

Co-authors

Danilo Cicalese (CERN) Grzegorz Jereczek (Intel Corporation)

Presentation Materials