6–7 Jun 2011
CERN
Europe/Zurich timezone

Qserv: Distributed Shared-nothing from MySQL and Xrootd

7 Jun 2011, 17:00
20m
IT Auditorium (CERN)

IT Auditorium

CERN

Speaker

Daniel Wang (SLAC National Accelerator Laboratory)

Description

The LSST catalog of celestial objects will need to answer both simple and complex queries over many billions of rows. Since no existing open-source database efficiently supports its requirements, we have are developing Qserv, a prototype database-style system, to handle such volumes. Qserv uses Xrootd as a framework for data-addressed communication to a cluster of machines with standalone MySQL instances. Xrootd provides fault-tolerance and replication support, while MySQL provides a basic SQL execution engine. Using a spatial spherical partitioning approach, Qserv fragments queries and aggregates results scalably even for expensive spatial self-joins.

Author

Daniel Wang (SLAC National Accelerator Laboratory)

Presentation materials