26–30 Oct 2009
Lawrence Berkeley National Laboratory
America/Los_Angeles timezone

Performance of Hadoop file system on a HEPiX storage workgroup testbed

26 Oct 2009, 14:45
30m
Bldg. 66 Auditorium (Lawrence Berkeley National Laboratory)

Bldg. 66 Auditorium

Lawrence Berkeley National Laboratory

1, Cyclotron Road, Berkeley, CA, 94720 USA
Storage Storage I

Speaker

Artem Trunov (Karlsruhe Institute of Technology)

Description

This work is continuation of storage solution testing performed by HEPiX storage workgroup on it's testbed at FZK. Hadoop, an Apache project, offers a cluster file system called HDFS inspired by Google File System and designed to run on commodity hardware. It has gained some popularity in OSG, where is has become a supported storage solution, and is currently in production at a few T2 sites. In this series of tests we used HEPiX testbed worker nodes' hard drives as a underlying storage, without using external file servers or storage arrays. We used a standard HEPiX storage application suite to evaluate performance of this solution. We present obtained results in this paper.

Author

Artem Trunov (Karlsruhe Institute of Technology)

Presentation materials