Speaker
Max Fischer
(KIT - Karlsruhe Institute of Technology (DE))
Description
Modern data processing solutions increasingly rely on data locality to achieve high data access rates and scalability. In contrast the common HEP system architectures emphasis uniform resource pools with minimal locality, allowing even for cross-site data access. The concept for the new High Performance Data Analysis (HPDA) Tier3 at KIT aims at introducing data locality to HEP batch systems. Coordinating dedicated cache drives on worker nodes, existing storage hierarchies are extended into the active batch system. The presentation will illustrate the considerations of extending the classic batch architecture and showcase the planned software and hardware architecture of the HPDA T3.
Primary author
Max Fischer
(KIT - Karlsruhe Institute of Technology (DE))
