13-17 February 2006
Tata Institute of Fundamental Research
Europe/Zurich timezone
Home > Timetable > Session details > Contribution details
PDF | XML | iCal

Sailing the petabyte sea: navigational infrastructure in the ATLAS event store

Presented by Dr. David MALON on 13 Feb 2006 from 11:00 to 11:20
Type: poster
Session: Poster
Track: Software Components and Libraries

Description

ATLAS has deployed an inter-object association infrastructure that allows the experiment to track at the object level what data have been written and where, and to assign both object-level and process-level labels to identify data objects for later retrieval. This infrastructure provides the foundation for opportunistic run-time navigation to upstream data, and in principle supports both dynamic determination of what data objects are reachable, and controlled-scope retrieval. This infrastructure is complementary to the coarser-grained bookkeeping and provenance management system used to identify which datasets were input to the production of which derived datasets, adding the capability to determine and locate the objects used to produce specific derived objects. It also simplifies the task of populating an event-level metadata system capable of returning references to events at any stage of processing. The tension between what the infrastructure can demonstrably support at site-level scales--it is already extensively utilized by ATLAS physicists--and what is expected to be constrained by policy in light of anticipated distributed storage resource limitations--is also discussed.

Place

Location: Tata Institute of Fundamental Research
Address: Homi Bhabha Road Mumbai 400005 India

Primary authors

More