19–21 Jun 2013
University of Geneva
Europe/Zurich timezone

Res. Data Session: Working with large data sets

20 Jun 2013, 15:15
25m
R380 (Uni Mail)

R380

Uni Mail

Speaker

Dr Tim Smith (CERN)

Description

Whether large or small, data sets need to be managed. Scale however makes standard data operations more challenging, especially when the data sets expand beyond the capacities of a single data centre. Consequently replication, migration and archival require optimised, sometimes domain specific solutions. Tim will illustrate the HEP approach by describing how CERN collected 100 petabytes of research data and how it organises storage and access by researchers across the globe. He will run through the data reduction and analysis chains up to paper production, and finish with the challenges of archiving these large data sets.

Presentation materials