Speaker
Vincent Garonne
(University of Oslo (NO))
Description
One of the biggest challenge with Large scale data management system is to ensure the consistency between the global file catalog
and what is physically on all storage elements.
To tackle this issue, the Rucio software which is used by the ATLAS Distributed Data Management system has been extended to
automatically handle lost or unregistered files (aka Dark Data). This system automatically detects these inconsistencies and take
actions like recovery or deletion of unneeded files in a central manner. In this talk, we will present this system, explain the
internals and give some results.
| Primary Keyword (Mandatory) | Distributed data handling |
|---|---|
| Secondary Keyword (Optional) | Storage systems |
Author
Vincent Garonne
(University of Oslo (NO))
