31 October 2022 to 3 November 2022
Clarion hotel Umeå
Europe/Amsterdam timezone

A Scalable and Efficient Staging System between Dcache and HPSS at BNL

3 Nov 2022, 15:20
25m
Clarion hotel Umeå

Clarion hotel Umeå

Storgatan 36, Umeå, Sweden
Storage & Filesystems Storage and Filesystems

Speaker

Zhenping Liu (Brookhaven National Laboratory)

Description

BNL recently implemented an efficient staging system between dCache and the backend HPSS tape storage. The system has three modules: the Endit Provider Plugin originated from NDGF, the ENDIT HPSSRetriever developed by BNL, and the optimized BNL’s HPSS Batch (ERADAT) system. This solution addresses performance bottlenecks in staging identified during the WLCG tape challenges. The system significantly improves overall tape staging performance through its asynchronous nature, alleviating heavy loads on stage hosts, and optimizing tape batch retrieval methods. As USATLAS dCache has demonstrated its effectiveness, we plan to extend this staging system to multiple instances of production dCache.

Speaker release Yes
Presentation will be held... remotely

Author

Zhenping Liu (Brookhaven National Laboratory)

Co-authors

Tim Chou Vincent Garonne (Brookhaven National Laboratory) Yingzi Wu (Brookhaven National Laboratory)

Presentation materials