Speaker
PATRICK MEADE
(University of Wisconsin-Madison)
Description
IceCube is a cubic kilometer neutrino detector located at the south pole. Metadata for files in IceCube has traditionally been handled on an application by application basis, with no user-facing access. There has been no unified view of data files, and users often just ls the filesystem to locate files. Recently effort has been put into creating such a unified view. Going for a simple solution, we created a user-facing REST API backed by a nosql database. All major data producers add their metadata to this central catalog. Challenges that were overcome include schema generation, containerized deployment, and scale testing.
Primary authors
David Schultz
(University of Wisconsin-Madison)
PATRICK MEADE
(University of Wisconsin-Madison)
Gonzalo Merino
(IceCube)
Heath Skarlupka
(University of Wisconsin)
Co-author
Jan Oertlin
(University of Wisconsin-Madison)
