Mar 6 – 8, 2023
Europe/Zurich timezone

Data at scale: from Storage to Data Governance

Mar 8, 2023, 10:00 AM
15m
Presentation Scalable Storage Backends for Cloud, HPC and Global Science Scalable Storage Backends

Speaker

Jean-Thomas Acquaviva (DDN Storage)

Description

Data are said to live forever, however their life is a complex journey. Initiated at acquisition or production date, data start a whole life cycle. During the different epochs of this life cycle, data will be moved, processed, compressed, shipped, archived.
To ease the management of this data orchestration, modern storage systems provide powerful tools. The foundation of these tools remains the ability to describes data with metadata

Metadata can be simple file information (date, size, format) or more complex, defining a structure including discipline-specific schema (or ontologies) used to address specific elements needed by a discipline.

In this talk we will present the layered approach of file systems, notably Lustre, to help end-users to implement a data governance solution.

Primary author

Presentation materials