Oct 10 – 14, 2016
San Francisco Marriott Marquis
America/Los_Angeles timezone

Rucio Auditor - Consistency in the ATLAS Distributed Data Management System

Oct 13, 2016, 3:30 PM
1h 15m
San Francisco Marriott Marquis

San Francisco Marriott Marquis

Poster Track 4: Data Handling Posters B / Break


Vincent Garonne (University of Oslo (NO))


One of the biggest challenge with Large scale data management system is to ensure the consistency between the global file catalog
and what is physically on all storage elements.
To tackle this issue, the Rucio software which is used by the ATLAS Distributed Data Management system has been extended to
automatically handle lost or unregistered files (aka Dark Data). This system automatically detects these inconsistencies and take
actions like recovery or deletion of unneeded files in a central manner. In this talk, we will present this system, explain the
internals and give some results.

Primary Keyword (Mandatory) Distributed data handling
Secondary Keyword (Optional) Storage systems

Primary author

Vincent Garonne (University of Oslo (NO))

Presentation materials