The Distributed Asynchronous Object Storage (DAOS) is an open-source object store designed from the ground up for massively distributed Non Volatile Memory (NVM). DAOS takes advantage of next-generation NVM technology, like Storage Class Memory (SCM) and NVM express (NVMe), and is extremely lightweight since it operates end-to-end in user space with full OS bypass. DAOS offers a shift away from an I/O model designed for block-based and high-latency storage to one that inherently supports fine-grained data access and unlocks the performance of the next-generation storage technologies such as Intel’s Optane DC Persistent Memory Modules (DCPMM). DAOS presents a key-value storage interface and features, such as transactional non-blocking I/O, advanced data protection with self-healing, end-to-end data integrity, fine-grained data control, and elastic storage, to optimize performance and cost.
This talk will introduce the technology from Intel in relation to Storage Class Memory and NVMe SSD, and the libraries being developed to take advantage of that technology. We introduce the architecture of the Distributed Asynchronous Object Storage (DAOS) and provide an overview of the rich data model and features that DAOS provides. We present the DAOS storage ecosystem and the integration with existing application workflows and I/O middleware libraries (e.g. POSIX, MPI-IO, HDF5, Spark) and provide some initial performance evaluation of our new storage stack.
This event is organized in collaboration with Intel: