21-27 March 2009
Prague
Europe/Prague timezone

A High Performance Data Transfer Service

26 Mar 2009, 08:00
1h
Prague

Prague

Prague Congress Centre 5. května 65, 140 00 Prague 4, Czech Republic
Board: Thursday 054
poster Grid Middleware and Networking Technologies Poster session

Speaker

Dr Iosif Legrand (CALTECH)

Description

To satisfy the demands of data intensive applications it is necessary to move to far more synergetic relationships between data transfer applications and the network infrastructure. The main objective of the High Performance Data Transfer Service we present is to effectively use the available network infrastructure capacity and to coordinate, manage and control large data transfer tasks between many distributed computing centers. The Fast Data Transfer (FDT) application is used to perform all data transfer tasks. FDT is capable of reading and writing at disk or storage speed over wide area networks using standard TCP. FDT is based on an asynchronous, flexible multithreaded system which is used to continuously stream a dataset though one or more TCP sockets. In the MonALISA framework, we developed a set of collaborating agents which are used to monitor the network topology and its load, the available computing and storage resources and based on all this information to efficiently schedule and optimize many concurrent data transfer tasks requested by users or production tools.

Primary authors

Presentation Materials