17-21 October 2016
US/Pacific timezone

EOS, DPM and FTS developments and plans

19 Oct 2016, 16:35
Building 50 Auditorium (LBNL)

Building 50 Auditorium


Berkeley, CA 94720
Storage & Filesystems Storage and Filesystems


Andrea Manzi (CERN)


The CERN IT-ST Analytics and Development section is responsible for the development of Data Management solution for Disk Storage and Data Transfer, namely EOS, DPM and FTS.

The talk will describe some recent developments in those 3 software solutions


The integration and evaluation of various technologies to do the transition from a single active in-memory namespace to a scale-out implementation distributed over many meta-data servers. The new architecture aims to separate the data from the application logic and user interface code, thus providing flexibility and scalability to the namespace component.


The implementation of a new core daemon (DOME) based on the fast-CGI and RESTful technologies. This brings the opportunity of working in a totally SRM-free mode, the implementation of quotas, free/used space on directories, and the implementation of volatile pools that can pull files from external sources, which can be used to deploy data caches.


The extension to better support data transfer workflows between Grid, Cloud and HPC systems. This includes FTS3 implementing protocol translations and performing efficient 3rd party transfers over HTTP. One of the core component ( Optimizer ) has been also rewritten to allow ranges of active transfers and better exploitation of the network resources.

Primary author

Presentation Materials