Oct 10 – 14, 2016
San Francisco Marriott Marquis
America/Los_Angeles timezone

XROOT development update - support for metalinks and extreme copy

Oct 10, 2016, 11:30 AM
15m
GG C3 (San Francisco Mariott Marquis)

GG C3

San Francisco Mariott Marquis

Oral Track 4: Data Handling Track 4: Data Handling

Speaker

Andrew Hanushevsky (STANFORD LINEAR ACCELERATOR CENTER)

Description

XRootD is a distributed, scalable system for low-latency file access. It is the primary data access framework for the high-energy physics community. One of the latest developments in the project has been to incorporate metalink and segmented file transfer technologies.
We report on the implementation of the metalink metadata format support within XRootD client. This includes both the CLI and the API semantics. Moreover, we give an overview of the employed segmented file transfer mechanism that exploits metalink-based data sources. Its aim is to provide multisource file transmission (BitTorrent-like), which results in increased transfer rates.
This contribution summarizes these two development projects and presents the outcomes.

Secondary Keyword (Optional) Distributed data handling
Tertiary Keyword (Optional) Algorithms
Primary Keyword (Mandatory) Storage systems

Primary author

Co-author

Andrew Hanushevsky (STANFORD LINEAR ACCELERATOR CENTER)

Presentation materials