15–19 Apr 2024
Laboratoire Astroparticule et Cosmologie (APC) de l'Université Paris-Cité
Europe/Paris timezone

Performance of Cluster File System Backed by an HDD-Based Data Storage System Under True Concurrent Read-Write Load

16 Apr 2024, 09:50
25m
Amphithéatre Buffon (Laboratoire Astroparticule et Cosmologie (APC) de l'Université Paris-Cité)

Amphithéatre Buffon

Laboratoire Astroparticule et Cosmologie (APC) de l'Université Paris-Cité

15 rue Hélène Brion 75013 Paris France
Storage & Filesystems Storage and file systems

Speaker

Uwe Falke (KIT SCC , GridKa)

Description

Despite of the growing number of flash-based data storage systems the usage of spinning disks (HDDs) for large on-line data storage systems is still advantageous. Measurements of the read-write behaviour of a cluster file system using external storage controllers backed by HDDs are presented. Contrary to commonly expected balanced read and write rates, resp., or even read rates slightly outbalancing write rates by far prevailing write rates were seen. Starting point was the test procedure required in a Call for Tenders which turned out to be totally inadequate to characterize the system behaviour. A more thorough approach showed that in true parallel read-write traffic attempting to maximise both data streams the read rate is about one order smaller than the write rate. Possible Explanations are considered and some discussion of the results is given.

Desired slot length 12
Speaker release Yes

Author

Uwe Falke (KIT SCC , GridKa)

Presentation materials