14-18 October 2013
Amsterdam, Beurs van Berlage
Europe/Amsterdam timezone

Distributing CMS Data between the Florida T2 and T3 Centers using Lustre and Xrootd-fs

14 Oct 2013, 15:00
45m
Grote zaal (Amsterdam, Beurs van Berlage)

Grote zaal

Amsterdam, Beurs van Berlage

Poster presentation Data Stores, Data Bases, and Storage Systems Poster presentations

Speaker

Dr Jorge Luis Rodriguez (UNIVERSITY OF FLORIDA)

Description

We have developed remote data access for large volumes of data over the Wide Area Network based on the Lustre filesystem and Kerberos authentication for security. It this paper we explore a prototype for two-step data access from worker nodes at Florida T3 centers, located behind a firewall and using a private network, to data hosted on the Lustre filesystem at the University of Florida CMS T2 center. The T2-T3 links are 10 Gigabit per second, and the typical round trip times are 10-15 msec. For each T3 center we use a client which mounts securely the Lustre filesystem and hosts a Xrootd server. The worker nodes access the data from the T3 client using POSIX compliant tools via the Xrootd-fs filesystem. We perform scalability tests with up to 200 jobs running in parallel on the T3 worker nodes.

Primary authors

Dr Dimitri Bourilkov (University of Florida (US)) Dr Jorge Luis Rodriguez (UNIVERSITY OF FLORIDA)

Presentation Materials

There are no materials yet.