Login

EOS 2024 Workshop

14โ€“15 Mar 2024
CERN
Europe/Zurich timezone
There is a live webcast for this event.

Contribution List

60 out of 60 displayed
Export to PDF
  1. 35. CERN Storage Day: Welcome to the IT Department
    Dirk Duellmann (CERN), Jakub Moscicki (CERN)
    14/03/2024, 09:00
  2. 36. CERN IT Storage and Data Management Group Overview
    Oliver Keeble (CERN)
    14/03/2024, 09:10
  3. 37. Large Scale Disk Storage: EOS
    Andreas Joachim Peters (CERN)
    14/03/2024, 09:30
  4. 38. Large Scale Tape Storage: CTA
    Joao Afonso (CERN)
    14/03/2024, 10:00
  5. 39. User and Collaboration Storage: CERNBox
    Giuseppe Lo Presti (CERN)
    14/03/2024, 10:50
  6. 40. Infrastructure Storage: Ceph
    Enrico Bocchi (CERN)
    14/03/2024, 11:10
  7. 41. More Filesystems: AFS,FILER,DFS,SAMBA,,...
    Enrico Bocchi (CERN), Sebastian Bukowiec (CERN)
    14/03/2024, 11:30
  8. 42. Content Delivery Storage: CVMFS
    Valentin Volkl (CERN)
    14/03/2024, 11:45
  9. 43. File Transfer Service (FTS)
    Joao Lopes
    14/03/2024, 12:00
  10. 44. Scientific Data Management: Rucio
    Martin Barisits (CERN)
    14/03/2024, 12:15
  11. 63. Group Photo and Logistics
    Luca Mascetti (CERN)
    14/03/2024, 12:30
  12. 1. CERNBox/Reva deployment at CERN
    14/03/2024, 14:00
  13. 49. Meet the team: Ceph FS
    14/03/2024, 14:00

    Discussion on the Ceph Filesystem.

    Go to contribution page
  14. 50. Meet the team: CERN Tape Archive (CTA) Operations
    14/03/2024, 14:00

    This session is open to all, but is geared towards sites with specific questions about CTA and tape operations.

    Go to contribution page
  15. 48. Meet the team: EOS & XRootD
    14/03/2024, 14:00
  16. 55. Meet the team: FTS/CVMFS/DFS
    14/03/2024, 14:00

    CVMFS: 513/R-070 - Openlab Space
    FTS: 28/S-029
    DFS: 31/2-28

    Go to contribution page
  17. 59. Meet the team: Ceph S3
    14/03/2024, 14:30

    Discussion on ceph-provisioned S3 object storage.

    Go to contribution page
  18. 56. Hands-on CERNBox/Reva and Cephfs
    14/03/2024, 15:00
  19. 60. Meet the team: Ceph RBD
    14/03/2024, 15:00

    Discussion on Ceph RADOS Block Devices.

    Go to contribution page
  20. 58. Meet the team: Ceph General
    14/03/2024, 15:30

    Ask us anything about Ceph.

    Go to contribution page
  21. 61. Meet the team: CERN Tape Archive (CTA) Newcomers
    14/03/2024, 15:30

    This session is open to all, but is geared towards sites who are newcomers to CTA or are interested in evaluating CTA for their archival storage needs.

    Go to contribution page
  22. 57. Hands-on CERNBox/Reva and EOS
    14/03/2024, 16:00
  23. 8. EOS 5.2 Status
    Elvin Alin Sindrilaru (CERN)
    15/03/2024, 08:30
  24. 14. EOS Namespace Locking Evolution
    Cedric Caffy (CERN)
    15/03/2024, 08:50
  25. 15. EOS FlatScheduler & Freespace Engine
    Abhishek Lekshmanan (CERN)
    15/03/2024, 09:10
  26. 9. EOS III
    Andreas Joachim Peters (CERN)
    15/03/2024, 09:25

    III = Instance Inventory Implementation

    We have added recently new tools to gather statics about storage hardware, resource usage, hardware lifecycle. These tools compute the virtual cost and value of user data and the hardware of an EOS instances.

    The presentation will introduce these new tools.

    Go to contribution page
  27. 12. EOSXd Evolution and CFSd
    Andreas Joachim Peters (CERN)
    15/03/2024, 09:35

    EOSXd is the filesystem client implemented as a FUSE filesystem to provide POSIX-like access to EOS. This is a crucial component for general usage of EOS. The presentation will highlight the problems we faced and advancements since the last workshop.

    EOS CFSd is a FUSE pass-through filesystem implementation allowing to add missing features to any general POSIX filesystems. The presentation...

    Go to contribution page
  28. 20. A new REST API Gateway for EOS
    Andreea Prigoreanu (IT-SD)
    15/03/2024, 10:10
  29. 31. Implementing FSCK for Erasure Coded Files in EOS
    Mano Segransan (42 Lausanne (CH))
    15/03/2024, 10:25
  30. 17. HTTP Improvements and SciTags
    Cedric Caffy (CERN)
    15/03/2024, 10:35
  31. 18. EOS and fixes & low level changes for openssl, xrootd & eosxd
    David Smith (CERN)
    15/03/2024, 10:45
  32. 11. EOS on ARM
    Abhishek Lekshmanan (CERN)
    15/03/2024, 10:55
  33. 13. EOS on SMR Status
    Andreas Joachim Peters (CERN)
    15/03/2024, 11:00

    In close collaboration with the IT procurement team we have conducted R&D with EOS and SMR disks. The findings, current status and outlook on integration of SMR disks will be covered in this presentation.

    Go to contribution page
  34. 32. A native S3 interface EOS/XRootD
    Mano Segransan (42 Lausanne (CH))
    15/03/2024, 11:05
  35. 34. XRootD Status and Plans
    Guilherme Amadio (CERN)
    15/03/2024, 11:15
  36. 46. NDMSPC - EOS and N-Dimensional Analysis with ROOT, Enhanced by Web Interface and VR Visualization
    Martin Vala (Pavol Jozef Safarik University (SK))
    15/03/2024, 11:30

    This talk delves into the synergy of NDMSPC (NDiMensional SPaCe), EOS at CERN, and N-dimensional histograms via the ROOT framework. Discover how a web interface serves as a powerful analysis tool, enabling dynamic queries on projections in N-dimensional space. Interact and visualize the data seamlessly with JSROOT and VR (aframe), ushering in a new era of immersive exploration in high-energy physics.

    Go to contribution page
  37. 54. ALICE File Consistency Check System: A new solution based on EOS FSCK
    Andreea Prigoreanu (IT-SD)
    15/03/2024, 11:40

    Undoubtedly, the processing of ALICE experiment data relies on the quality and integrity of data. Currently, ALICE uses a distributed file crawler that periodically evaluates samples of files from each storage element in order to gather statistics about the number of corrupted or inaccessible files. The main issue with this solution lies in its inability to provide a comprehensive overview of...

    Go to contribution page
  38. 24. EOS Benchmarks at CERN
    Andreas Joachim Peters (CERN)
    15/03/2024, 11:50

    Before and after Run 3 have conducted several performance benchmarks as preparation of DC'24 and Run-3 in 2024 on various EOS instances at CERN. The presentation will report the findings of these benchmarks.

    Go to contribution page
  39. 7. eosxd-csi: Mounting EOS volumes in Kubernetes
    Robert Vasek (CERN)
    15/03/2024, 13:35

    Kubernetes is seeing a huge adoption across the cloud, including the one at CERN. Already used in production, the EOSxd-CSI driver exposes EOS volumes as regular PersistentVolumeClaims that can be mounted by containerized workloads. This talk will touch on storage stack in Kubernetes, how EOS falls into the mix, and finally a demo showing the CSI driver in action.

    Go to contribution page
  40. 22. EOS4PHysics Operations
    Dr Maria Arsuaga Rios (CERN)
    15/03/2024, 13:45
  41. 10. EOS ALMA9 Migration
    Ioanna Vrachnaki
    15/03/2024, 14:05
  42. 25. EOS Hardware Procurement
    Luca Mascetti (CERN)
    15/03/2024, 14:20
  43. 23. Long Term Monitoring with Prometheus + Thanos
    Roberto Valverde Cameselle (CERN)
    15/03/2024, 14:30

    The Storage and Data Management Group at CERN manages 20 EOS instances corresponding to almost 1000 servers and 100,000 disks. Having a good monitoring and alerting system is crucial not only for day-to-day activities but also as a tool to record the evolution of our services throughout the time. In this talk an overview of the monitoring tools that are used will be presented specially in...

    Go to contribution page
  44. 6. Comparison of High-Performance Distributed File Systems on two Platforms: Linux and Windows
    Gregor Molan (Comtrade 360's AI Lab)
    15/03/2024, 14:45

    Subtitle: Superiority of EOS-based Comtrade Distributed File System (CDFS) for Earth Observation Data Storage.

    Introduction

    The rising quantity of data collected necessitates transitioning to the next generation of reliable, high-performance data storage solutions. Despite the clear need for high-performance storage across many industries, there has yet to be a consensus on...

    Go to contribution page
  45. 26. CERNBox Update
    Emmanouil Bagakis (CERN)
    15/03/2024, 15:00
  46. 4. Site Report Vienna Tier-2
    Erich Birngruber (Austrian Academy of Sciences (AT))
    15/03/2024, 15:10

    We share our operational experience of running a converged EOS instance for 3 Experiments (CMS, Alice, Belle).

    • In 2022 we've extended the capacity of the EOS cluster from 9 to 15 FSTs
    • In 2023 we've successfully updated to EOS 5.2.2
    • The system deployment and all operational tasks are fully automated with Ansible. Most recently a gap was closed with the automation of host...
    Go to contribution page
  47. 3. EOS Operation Status at KISTI Tier-1 for ALICE experiment
    Sang Un Ahn (Korea Institute of Science & Technology Information (KR))
    15/03/2024, 15:25

    We have been running disk and archive (replacing tape) storage for ALICE experiment with EOS for several years. In 2023, we upgraded our EOS instances to v5 from v4. More recently we deployed EOS based on Podman (instead of Docker), which is adapted as a native container runtime in EL9 distributions. In this work, we present the current status of EOS operation at KISTI Tier-1 centre based on...

    Go to contribution page
  48. 45. EOS site report of the Joint Research Centre
    Armin Burger (EC Joint Research Centre)
    15/03/2024, 15:55

    The Joint Research Centre (JRC) of the European Commission is running the Big Data Analytics Platform (BDAP) to enable the JRC projects to store, process, and analyze a wide range of data and disseminate data products. The platform evolved as a core service for JRC scientists to produce knowledge and insights in support of EU policy making.

    EOS is the main storage system of the BDAP for...

    Go to contribution page
  49. 51. EOS Status at IHEP
    LI Haibo lihaibo
    15/03/2024, 16:10

    The Institute of High Energy Physics (IHEP) has been utilizing the EOS storage system since 2016, with the current capacity nearing 60PB. We use EOS to provide both disk and tape storage solutions for HEP experiments. This report will introduce some of work we carried out in 2023, which include:
    1. The adoption of EOS as SE for the WLCG Tier2, replacing the previous DPM system, and the...

    Go to contribution page
  50. 5. EOS at the Fermilab LHC Physics Center
    Dan Szkola (Fermi National Accelerator Lab. (US))
    15/03/2024, 16:25

    Fermilab has been running an EOS instance since testing began in June 2012. By May 2013, before becoming production storage, there was 600TB allocated for EOS. Today, there is approximately 13PB of storage available in the EOS instance.

    The LPC cluster is a 4500-core user analysis cluster with 13 PB of EOS storage. The LPC cluster supports several hundred active CMS users at any given...

    Go to contribution page
  51. 47. Purdue EOS status report
    Stefan Piperov (Purdue University (US))
    15/03/2024, 16:40

    Purdue University switched to EOS storage a couple of years back, and we are still exploring/appreciating the benefits of this distributed file-system. In this talk we will give a brief status report and will outline our plans for using EOS at the CMS Tier-2 center at Purdue.

    Go to contribution page
  52. 53. Shared EOS instance at JINR
    Nikita Balashov (Joint Institute for Nuclear Research (RU))
    15/03/2024, 16:55

    The
    Joint Institute for Nuclear Research (JINR) utilizes a diverse
    storage ecosystem, encompassing a number of dCache, EOS and Ceph
    storage instances to address varied scientific needs. In this report
    we focus on one of the largest EOS instances at JINR, operational
    since 2019 as a shared storage system for experimental data.
    Presently, it has the capacity of 22 PB and hosts over 7 PB of...

    Go to contribution page
  53. 33. Roadmap 2024
    Andreas Joachim Peters (CERN), Elvin Alin Sindrilaru (CERN)
    15/03/2024, 17:10

    The presentation will summarize plans of the EOS team for 2024 and beyond.

    Go to contribution page
  54. 52. Roadmap Discussion
    15/03/2024, 17:20
  55. 27. CIFS Update
    Giu LoPresti
  56. 30. Configuring EOS
  57. 29. CTA Update
  58. 62. CVMFS: Openlab room
  59. 28. EOS on lxplus/lxbatch
  60. 16. Group Balancer Free Space Engine
    Abhishek Lekshmanan (CERN)