Help us make Indico better by taking this survey! Aidez-nous à améliorer Indico en répondant à ce sondage !

Sep 2 – 9, 2007
Victoria, Canada
Europe/Zurich timezone
Please book accomodation as soon as possible.

High Performance Data Analysis for Particle Physics using the Gfarm File System

Sep 5, 2007, 8:00 AM
10h 10m
Victoria, Canada

Victoria, Canada

Board: 91
poster Grid middleware and tools Poster 2

Speaker

Prof. Nobuhiko Katayama (High Energy Accelerator Research Organization)

Description

The Belle experiment operates at the KEKB accelerator, a high luminosity asymmetric energy e+ e- collider. The Belle collaboration studies CP violation in decays of B meson to answer one of the fundamental questions of Nature, the matter-anti-matter asymmetry. Currently, Belle accumulates more than one million B Bbar meson pairs that correspond to about 1.2 TB of raw data in one day. The amount of raw data is expected to increase by 50 times after an upgrade of the KEKB accelerator. The challenge is how to realize required high performance data access and scalable data computing. Our solution is the Gfarm file system. It is a commodity-based Grid-wide network shared file system that federates local storage of cluster nodes; moreover it provides scalable I/O performance with distributed data access. We constructed a Gfarm file system with 26 TB capacity and 52 GB/sec I/O bandwidth, integrating local disks of 1112 compute nodes in the KEKB computing facility, and measured scalability of disk I/O performance up to more than 1000 nodes. We also performed a real Belle data analysis program using more than 700 nodes at the speed of 24GB/s, reducing the Belle data analysis time by a factor of about 1,000.
Submitted on behalf of Collaboration (ex, BaBar, ATLAS) Belle

Primary authors

Dr Ichiro Adachi (HIGH ENERGY ACCELERATOR RESEARCH ORGANIZATION) Prof. Nobuhiko Katayama (High Energy Accelerator Research Organization) Prof. Osamu Tatebe (Tsukuba University) Dr Shohei Nishida (HIGH ENERGY ACCELERATOR RESEARCH ORGANIZATION)

Presentation materials