14-18 October 2013
Amsterdam, Beurs van Berlage
Europe/Amsterdam timezone

Dataset-based High-Level Data Transfer System in BESDIRAC

14 Oct 2013, 15:00
45m
Grote zaal (Amsterdam, Beurs van Berlage)

Grote zaal

Amsterdam, Beurs van Berlage

Poster presentation Distributed Processing and Data Handling A: Infrastructure, Sites, and Virtualization Poster presentations

Speaker

Mr Tao Lin (Institute of High Energy Physics)

Description

Data Transfer is an essential part in grid. In the BESIII experiment, the result of Monte Carlo Simulation should be transfered back from other sites to IHEP and the DST files for physics analysis should be tranfered from IHEP to other sites. A robust transfer system should make sure all data are transfered correctly. DIRAC consists of cooperation distributed services and light-weight agents delivering the workload to the Grid Resources. We reuse the most basic functionalities supplied by DIRAC. BESDIRAC is an extension to DIRAC for BES specified. In BESDIRAC, a Dataset-based Data Transfer System is developed. In this paper, we present the design of this system and its implementation details. A Transfer Request Service is used for creating and monitoring the transfer requests. A Transfer Agent is used for transfering data from one SE to another. For flexibility and reuse of the current low-level transfer systems, we have designed a transfer worker factory to create transfer workers with different protocols. A transfer worker is the wrapper of the low-level file transfer commands. The Transfer Agent uses the Async I/O to manage the transfer workers.

Primary authors

Mr Tao Lin (Institute of High Energy Physics) Dr Xiaomei Zhang (Institute of High Energy Physics)

Co-authors

Andrei Tsaregorodtsev (Marseille) Prof. Weidong Li (Institute of High Energy Physics)

Presentation Materials