18-22 April 2016
DESY Zeuthen
Europe/Berlin timezone

Fermilab's Scientific Computing Storage Architecture

20 Apr 2016, 09:00
25m
Seminar room 3 (DESY Zeuthen)

Seminar room 3

DESY Zeuthen

Platanenallee 6, 15738 Zeuthen (near Berlin), Germany
Storage & Filesystems Storage and file systems

Speaker

Gerard Bernabeu Altayo (Fermilab)

Description

High Energy Physics experiments record and simulate very large volumes of data and the trend in the future is only going up. All this data needs to be archived, and accessed by central processing workflows as well as a diverse group of scientists to extract physics results. Fermilab supports a wealth of storage technologies for the experiments for very different tasks, from NFS mounted appliances to mass storage systems handling transparent access to files on tape through large disk caches. To prepare for the future, Fermilab recently developed a Scientific Computing Storage Architecture to consolidate and to prepare for a future evolution of the supported storage forms. A big aspect was to remove POSIX access to the storage systems from the worker nodes, necessary to be able to transparently support workflows on different resources like the local batch systems, grids and commercial clouds. In this presentation, we will discuss the architecture and describe how experts categorizes workloads accessing storage, files and access patterns. We are currently in the process of implementing this strategy together with Fermilab’s experiments and projects and will report on the progress.
Length of presentation (minutes, max. 20) 15

Primary author

Co-author

Oliver Gutsche (Fermi National Accelerator Lab. (US))

Presentation Materials