Nov 4 – 8, 2019
Adelaide Convention Centre
Australia/Adelaide timezone

BNL Cloud Storage Service BNLBox

Nov 7, 2019, 3:30 PM
1h
Hall F (Adelaide Convention Centre)

Hall F

Adelaide Convention Centre

Poster Track 4 – Data Organisation, Management and Access Posters

Speaker

Ofer Rind

Description

Large scientific data centers have recently begun providing a number of different types of data storage, to satisfy the various needs of their users. Users with interactive accounts, for example, might want a posix interface for easy access to the data from their interactive machines. Grid computing sites, on the other hand, likely need to provide an X509 based storage protocol, like SRM and GridFTP, since the data management system is built on top of them. Meanwhile, an experiment producing large amounts of data typically demands a service that provides archival storage for the safe keeping of their unique data. To access these various types of data, users must use specific sets of commands tailored for the respective storage, making access to their data complex and difficult. BNLBox is an attempt to provide a unified and easy to use storage service for all BNL users, scientists and engineers, to store their important documents, code and data. It is a cloud storage system with an intuitive web interface for novice users. It provides an automated synchronization feature that enables users to upload data to their cloud storage without manual intervention, freeing them to focus on analysis rather than data management software. It provides a posix interface for local interactive users, which simplifies data access from batch jobs as well. At the same time, it also provides users with a straightforward mechanism for archiving large data sets for later processing. The storage space can be used for both code and data within the compute job environment. This presentation will cover the various aspects of the BNLBox storage service.

Consider for promotion No

Primary authors

Hironori Ito (Brookhaven National Laboratory (US)) Ofer Rind Tejas Rao Mr Tim Chou (Brookhaven National Laboratory) Alexandr Zaytsev (Brookhaven National Laboratory (US)) Zhenping Liu (Brookhaven National Laboratory (US)) Yingzi Wu (Brookhaven National Laboratory (US)) Ognian Novakov (Brookhaven National Laboratory) Guangwei Che (Brookhaven National Laboratory) Robert Hancock (Brookhaven National Laboratory) Mizuki Karasawa (BNL)

Presentation materials