Indico celebrates its 20th anniversary! Check our blog post for more information!

15–19 Mar 2021
Europe/Zurich timezone

The design of Data Management System at HEPS

17 Mar 2021, 08:00
25m
Online workshop

Online workshop

Storage & Filesystems Storage & File Systems

Speaker

Hao Hu (Institute of High Energy of Physics)

Description

According to the estimated data rates, we predict 24 PB raw experimental data will be produced per month from 14 beamlines at the first stage of High Energy Photon Source (HEPS), and the volume of experimental data will be even greater with the completion of over 90 beamlines at the second stage in the future. To make sure that huge amount of data collected at HEPS is accurate, available and accessible, an effective data management system (DMS) is crucial piece of deploying the IT systems. We design a DMS for HEPS which is responsible for automating the organization, transfer, storage, distribution and sharing of the data produced from experiments. First, the general situation of HEPS is introduced in this paper. Second, the architecture and data flow of the HEPS DMS are described from the perspective of facility users and IT, and the key techniques implemented in this system are introduced. Furthermore, the progress and the effect of the DMS deployed as a testbed at 1W1A of BSRF are shown.

Speaker release Yes

Primary authors

Hao Hu (Institute of High Energy of Physics) Ms Hongmei Zhang Qi Fazhi (IHEP) Mr Haolai Tian Mr Qi Luo

Presentation materials