10–14 Oct 2016
San Francisco Marriott Marquis
America/Los_Angeles timezone

Globally Distributed Software Defined Storage

13 Oct 2016, 15:30
1h 15m
San Francisco Marriott Marquis

San Francisco Marriott Marquis

Poster Track 4: Data Handling Posters B / Break

Speaker

Andrey Shevel (Petersburg Nuclear Physics Institute - PNPI, ITMO University)

Description

The volume of the coming data in HEP is growing. Also growing volume of the data to be hold long time. Actually large volume of data – big data – is distributed around the planet. In other words now there is situation where the data storage does integrate storage resources from many data centers located far from each other. That means the methods, approaches how to organize, manage the globally distributed data storage are required.
For personal needs the distributed storage has several examples like owncloud.org, pydio.com, seafile.com, sparkleshare.org. For enterprise level there are a number of distributed storage systems SWIFT (part of Openstack), CEPH and the like which are mostly object storage.
When distributed storage integrate several data center resources the organization of data links becomes very important issue especially if several parallel data links between data centers are used. The situation on data centers and in data links might be changed each half a day or more often. All that means each part of distributed data storage has to be able to rearrange usage of data links and storage servers in each data center. In addition for each customer of distributed storage the different requirements have to be satisfied.
Mentioned topics and more are planned to present in the proposal under discussion.

Primary Keyword (Mandatory) Storage systems
Secondary Keyword (Optional) Cloud technologies
Tertiary Keyword (Optional) Network systems and solutions

Primary author

Andrey Shevel (Petersburg Nuclear Physics Institute - PNPI, ITMO University)

Co-authors

Mr Arsen Kairkanov (ITMO University) Dr Mikhail Kompaniets (St. Petersburg State University (RU)) Mr Oleg Sadov (ITMO University) Prof. Sergey Khoruzhnikov (ITMO University) Dr Vladimir Grudinin (ITMO University)

Presentation materials