EOS workshop

Session

EOS Production Services

3 Feb 2020, 10:15

31/3-004 - IT Amphitheatre (CERN)

43. CERN Disk Storage Services

Luca Mascetti (CERN)

03/02/2020, 10:15

The CERN IT Storage group operates multiple distributed storage systems to support all CERN data storage requirements: the physics data generated by LHC and non-LHC experiments; object and file storage for infrastructure services; block storage for the CERN cloud system; filesystems for general use and specialized HPC clusters; content distribution filesystem for software distribution and...

17. EOS+CTA: Adding tape storage capability to EOS

Michael Davis (CERN)

03/02/2020, 10:30

The CERN Tape Archive (CTA) is the tape back-end to EOS. Configuring EOS to work with CTA allows event-based triggering of tape archivals and retrievals. As well as controlling the tape hardware (libraries and drives), CTA provides an advanced queue manager and scheduler to manage how and when tapes will be mounted, to optimise the use of the tape infrastructure. This presentation will provide...

9. EOS as storage back-end for JRC data science

Mr Armin Burger (European Commission - Joint Research Centre)

03/02/2020, 10:45

The Joint Research Centre (JRC) of the European Commission has set up the JRC Earth Observation Data and Processing Platform (JEODPP) as an infrastructure to enable the JRC projects to process and analyze big data, extracting knowledge and insights in support of EU policy making. The main focus is related to geospatial data, but has been extended to other data domains. EOS is the main storage...

5. Alternative to tape based archive storage project at KISTI

Heejune Han (Korea Institute of Science & Technology Information (KR)), Jeongheon Kim (Korea Institute of Science and Technology Information), Sang Un Ahn (Korea Institute of Science & Technology Information (KR))

03/02/2020, 11:00

This contribution is about the current status of the project on procurement and deployment of a custodial storage system based on high-density JBOD enclosures with EOS RAIN. System design and considerations, preliminary test results, procurement, installation and basic deployment setup will be presented.

37. The great migration - decommissioning the Wigner data centre.

Oliver Keeble (CERN)

03/02/2020, 11:15

During 2019 CERN decommissioned its data centre in Wigner, Hungary. This contribution gives an overview of how 90PB of EOS-managed storage was successfully dismantled and the data relocated to the central Geneva site, maintaining full availability of the service and the data.

41. EOS operations: deployment of QuarkDB as namespace backend

Cristian Contescu (CERN)

03/02/2020, 11:25

2019 was the year of migration on many levels. In this presentation we would like to outline the deployment of the new namespace backend, based on QuarkDB, replacing the in-memory namespace. We will talk about the reasons behind the change, the planning, initial implementation, some challenges and the outcome of this migration.

36. EOSHOME Backup Update

Roberto Valverde Cameselle (CERN)

03/02/2020, 11:35

EOS Home (CERNBox) has now more than 20K users and projects spaces which need to be backed up every day. In order to improve our current backup system, we developed a distributed backup/restore system based on opensource tool restic which stores backup data on CERN S3 service. We are presenting an update on the current status of the project and future challenges.

40. FUSEX / client deployment status at CERN

Jan Iven (CERN)

03/02/2020, 11:40

A brief overview how EOS FUSEX (and client in general) are rolled out and configured at CERN. 5min

7. Herding K8S

Crystal Michelle Chua

03/02/2020, 11:50

Over the last year, as part of developing our S3 gateway service, we have started deploying EOS using Kubernetes at AARNet. This will be a quick talk on how we set up our environments and the tooling we use to make deployments easy, and will include a short section on our current EOS usage and the instances we run.

56. EOS Documentation for Enterprise Users

Gregor Molan (COMTRADE D.O.O (SI))

03/02/2020, 12:00

EOS is a disk-based file system designed to be a fast, low-latency, high availability, and elastic storage to capture the results of CERN experiments. Nowadays, EOS has been developed to the stage where it became potentially interesting for enterprise users – that is where Comtrade with its vast experience with enterprise software development came in.

The documentation development process...