14โ€“15 Mar 2024
CERN
Europe/Zurich timezone
There is a live webcast for this event.

Session

EOS Operations

15 Mar 2024, 13:25
31/3-004 - IT Amphitheatre (CERN)

31/3-004 - IT Amphitheatre

CERN

105
Show room on map

Presentation materials

There are no materials yet.

  1. Robert Vasek (CERN)
    15/03/2024, 13:35

    Kubernetes is seeing a huge adoption across the cloud, including the one at CERN. Already used in production, the EOSxd-CSI driver exposes EOS volumes as regular PersistentVolumeClaims that can be mounted by containerized workloads. This talk will touch on storage stack in Kubernetes, how EOS falls into the mix, and finally a demo showing the CSI driver in action.

    Go to contribution page
  2. Dr Maria Arsuaga Rios (CERN)
    15/03/2024, 13:45
  3. Ioanna Vrachnaki
    15/03/2024, 14:05
  4. Luca Mascetti (CERN)
    15/03/2024, 14:20
  5. Roberto Valverde Cameselle (CERN)
    15/03/2024, 14:30

    The Storage and Data Management Group at CERN manages 20 EOS instances corresponding to almost 1000 servers and 100,000 disks. Having a good monitoring and alerting system is crucial not only for day-to-day activities but also as a tool to record the evolution of our services throughout the time. In this talk an overview of the monitoring tools that are used will be presented specially in...

    Go to contribution page
  6. Gregor Molan (Comtrade 360's AI Lab)
    15/03/2024, 14:45

    Subtitle: Superiority of EOS-based Comtrade Distributed File System (CDFS) for Earth Observation Data Storage.

    Introduction

    The rising quantity of data collected necessitates transitioning to the next generation of reliable, high-performance data storage solutions. Despite the clear need for high-performance storage across many industries, there has yet to be a consensus on...

    Go to contribution page
  7. Emmanouil Bagakis (CERN)
    15/03/2024, 15:00
  8. Erich Birngruber (Austrian Academy of Sciences (AT))
    15/03/2024, 15:10

    We share our operational experience of running a converged EOS instance for 3 Experiments (CMS, Alice, Belle).

    • In 2022 we've extended the capacity of the EOS cluster from 9 to 15 FSTs
    • In 2023 we've successfully updated to EOS 5.2.2
    • The system deployment and all operational tasks are fully automated with Ansible. Most recently a gap was closed with the automation of host...
    Go to contribution page
  9. Sang Un Ahn (Korea Institute of Science & Technology Information (KR))
    15/03/2024, 15:25

    We have been running disk and archive (replacing tape) storage for ALICE experiment with EOS for several years. In 2023, we upgraded our EOS instances to v5 from v4. More recently we deployed EOS based on Podman (instead of Docker), which is adapted as a native container runtime in EL9 distributions. In this work, we present the current status of EOS operation at KISTI Tier-1 centre based on...

    Go to contribution page
  10. Armin Burger (EC Joint Research Centre)
    15/03/2024, 15:55

    The Joint Research Centre (JRC) of the European Commission is running the Big Data Analytics Platform (BDAP) to enable the JRC projects to store, process, and analyze a wide range of data and disseminate data products. The platform evolved as a core service for JRC scientists to produce knowledge and insights in support of EU policy making.

    EOS is the main storage system of the BDAP for...

    Go to contribution page
  11. LI Haibo lihaibo
    15/03/2024, 16:10

    The Institute of High Energy Physics (IHEP) has been utilizing the EOS storage system since 2016, with the current capacity nearing 60PB. We use EOS to provide both disk and tape storage solutions for HEP experiments. This report will introduce some of work we carried out in 2023, which include:
    1. The adoption of EOS as SE for the WLCG Tier2, replacing the previous DPM system, and the...

    Go to contribution page
  12. Dan Szkola (Fermi National Accelerator Lab. (US))
    15/03/2024, 16:25

    Fermilab has been running an EOS instance since testing began in June 2012. By May 2013, before becoming production storage, there was 600TB allocated for EOS. Today, there is approximately 13PB of storage available in the EOS instance.

    The LPC cluster is a 4500-core user analysis cluster with 13 PB of EOS storage. The LPC cluster supports several hundred active CMS users at any given...

    Go to contribution page
  13. Stefan Piperov (Purdue University (US))
    15/03/2024, 16:40

    Purdue University switched to EOS storage a couple of years back, and we are still exploring/appreciating the benefits of this distributed file-system. In this talk we will give a brief status report and will outline our plans for using EOS at the CMS Tier-2 center at Purdue.

    Go to contribution page
  14. Nikita Balashov (Joint Institute for Nuclear Research (RU))
    15/03/2024, 16:55

    The
    Joint Institute for Nuclear Research (JINR) utilizes a diverse
    storage ecosystem, encompassing a number of dCache, EOS and Ceph
    storage instances to address varied scientific needs. In this report
    we focus on one of the largest EOS instances at JINR, operational
    since 2019 as a shared storage system for experimental data.
    Presently, it has the capacity of 22 PB and hosts over 7 PB of...

    Go to contribution page
  15. Giu LoPresti
Building timetable...