Speaker
Description
In this contribution we report on the re-factoring and re-configuration of main components of the International Lattice Data Grid (ILDG) in order to realize a modern data management framework which is fully FAIR-compliant and has a completely token-based access control.
ILDG started 20 years ago as an effort of the Lattice QCD community to organize and enable the worldwide sharing of large data sets from expensive numerical simulations. At that time, it leveraged grid technologies, like those used for the LHC grid. Two crucial aspects of the modernization of ILDG during the past three years were the setup of a new global user management through a dedicated INDIGO IAM instance, and the re-implementation of the metadata and file catalogs.
The new IAM was pivotal to the transition to a (capability-) token-based and fine-grained access control for all catalog and storage services. This completely eliminates the use of grid certificates, facilitates the use of data stores based on cloud technologies, and enables collaboration-internal data sharing with rigorous handling of embargo restrictions.
The metadata catalog supports multiple and freely configurable metadata schemata. Together with file catalogs this provides the essential building blocks for a modular, flexible, and FAIR-compliant data management framework.
With an updated revision of the rich QCDml metadata schema, ILDG 2.0 is now fully operational and FAIR-compliant. Moreover, an ILDG-like setup is considered as favorable solution for use-cases beyond Lattice QCD, e.g. for axion experiments or radio-astronomy.