Mar 6 – 8, 2023
Europe/Zurich timezone

Comparison between CephFS, CFFS (Comtrade FastFS), HDFS (Apache Hadoop), GPFS (IBM Spectrum Scale), Lustre

Mar 8, 2023, 9:30 AM
15m
Presentation Scalable Storage Backends for Cloud, HPC and Global Science Scalable Storage Backends

Speaker

Gregor Molan (Comtrade 360's AI Lab)

Description

Different high-performance, high-available file systems can store big data (hundreds of PB) and provide high data throughput (hundreds of TB per second). Each of these solutions highlights its advantages, and it is challenging to compare them.

Based on 30 years of storage development experience, Comtrade provided test scenarios to compare these file systems. On the appropriate high-performance hardware, here are the results from January 2023 that helps companies to choose appropriate high-performance file systems that fulfil given requirements. The limitation of this comparison is limited only to performance, while other essential features, such as software maintenance and upgradeability, are not covered in this comparison.

Primary author

Gregor Molan (Comtrade 360's AI Lab)

Presentation materials