Speaker
Andrew Hanushevsky
(STANFORD LINEAR ACCELERATOR CENTER)
Description
XRootD is a distributed, scalable system for low-latency file access. It is the primary data access framework for the high-energy physics community. One of the latest developments in the project has been to incorporate metalink and segmented file transfer technologies.
We report on the implementation of the metalink metadata format support within XRootD client. This includes both the CLI and the API semantics. Moreover, we give an overview of the employed segmented file transfer mechanism that exploits metalink-based data sources. Its aim is to provide multisource file transmission (BitTorrent-like), which results in increased transfer rates.
This contribution summarizes these two development projects and presents the outcomes.
| Primary Keyword (Mandatory) | Storage systems |
|---|---|
| Secondary Keyword (Optional) | Distributed data handling |
| Tertiary Keyword (Optional) | Algorithms |
Author
Michal Kamil Simon
(CERN)
Co-author
Andrew Hanushevsky
(STANFORD LINEAR ACCELERATOR CENTER)
