14–18 Oct 2019
Amsterdam Science Park Congress Centre
Europe/Amsterdam timezone

NOTED: Network-Optimized Transfer of Experimental Data

16 Oct 2019, 14:00
25m
Turingzaal (Amsterdam Science Park Congress Centre)

Turingzaal

Amsterdam Science Park Congress Centre

Science Park 123 1098 XG Amsterdam The Netherlands 52°21'23"N, 4°57'7"E
Networking & Security Networking and Security

Speaker

Coralie Busse-Grawitz (ETH Zurich (CH))

Description

We describe the software tool-set being implemented in the context of the NOTED [1] project to better exploit WAN bandwidth for Rucio and FTS data transfers, how it has been developed and the results obtained.
The first component is a generic data-transfer broker that interfaces with Rucio and FTS. It identifies data transfers for which network reconfiguration is both possible and beneficial, translates the Rucio and FTS information into parameters that can be used by network controllers and makes these available via a public interface.
The second component is a network controller that, based on the parameters provided by the transfer broker, decides which actions to apply to improve the path for a given transfer.
Unlike the transfer broker, the network controller described here is tailored to the CERN network as it has to choose the appropriate action given the network configuration and protocols used at CERN. However, this network controller can easily be used as a model for site-specific implementations elsewhere.
The paper describes the design and the implementation of the two tools, the tests performed and the results obtained. It also analyses how the tool-set could be used for WLCG in the context of the DOMA [2] activity.
[1] Network Optimisation for Transport of Experimental Data - CERN project
[2] Data Organisation, Management and Access - WLCG activity

Speaker release Yes

Primary authors

Presentation materials