This session is open to all, but is geared towards sites with specific questions about CTA and tape operations.
CVMFS: 513/R-070 - Openlab Space
FTS: 28/S-029
DFS: 31/2-28
Discussion on ceph-provisioned S3 object storage.
Discussion on Ceph RADOS Block Devices.
This session is open to all, but is geared towards sites who are newcomers to CTA or are interested in evaluating CTA for their archival storage needs.
III = Instance Inventory Implementation
We have added recently new tools to gather statics about storage hardware, resource usage, hardware lifecycle. These tools compute the virtual cost and value of user data and the hardware of an EOS instances.
The presentation will introduce these new tools.
EOSXd is the filesystem client implemented as a FUSE filesystem to provide POSIX-like access to EOS. This is a crucial component for general usage of EOS. The presentation will highlight the problems we faced and advancements since the last workshop.
EOS CFSd is a FUSE pass-through filesystem implementation allowing to add missing features to any general POSIX filesystems. The presentation...
In close collaboration with the IT procurement team we have conducted R&D with EOS and SMR disks. The findings, current status and outlook on integration of SMR disks will be covered in this presentation.
This talk delves into the synergy of NDMSPC (NDiMensional SPaCe), EOS at CERN, and N-dimensional histograms via the ROOT framework. Discover how a web interface serves as a powerful analysis tool, enabling dynamic queries on projections in N-dimensional space. Interact and visualize the data seamlessly with JSROOT and VR (aframe), ushering in a new era of immersive exploration in high-energy physics.
Undoubtedly, the processing of ALICE experiment data relies on the quality and integrity of data. Currently, ALICE uses a distributed file crawler that periodically evaluates samples of files from each storage element in order to gather statistics about the number of corrupted or inaccessible files. The main issue with this solution lies in its inability to provide a comprehensive overview of...
Before and after Run 3 have conducted several performance benchmarks as preparation of DC'24 and Run-3 in 2024 on various EOS instances at CERN. The presentation will report the findings of these benchmarks.
The Storage and Data Management Group at CERN manages 20 EOS instances corresponding to almost 1000 servers and 100,000 disks. Having a good monitoring and alerting system is crucial not only for day-to-day activities but also as a tool to record the evolution of our services throughout the time. In this talk an overview of the monitoring tools that are used will be presented specially in...
Subtitle: Superiority of EOS-based Comtrade Distributed File System (CDFS) for Earth Observation Data Storage.
Introduction
The rising quantity of data collected necessitates transitioning to the next generation of reliable, high-performance data storage solutions. Despite the clear need for high-performance storage across many industries, there has yet to be a consensus on...
We share our operational experience of running a converged EOS instance for 3 Experiments (CMS, Alice, Belle).
- In 2022 we've extended the capacity of the EOS cluster from 9 to 15 FSTs
- In 2023 we've successfully updated to EOS 5.2.2
- The system deployment and all operational tasks are fully automated with Ansible. Most recently a gap was closed with the automation of host...
We have been running disk and archive (replacing tape) storage for ALICE experiment with EOS for several years. In 2023, we upgraded our EOS instances to v5 from v4. More recently we deployed EOS based on Podman (instead of Docker), which is adapted as a native container runtime in EL9 distributions. In this work, we present the current status of EOS operation at KISTI Tier-1 centre based on...
The Joint Research Centre (JRC) of the European Commission is running the Big Data Analytics Platform (BDAP) to enable the JRC projects to store, process, and analyze a wide range of data and disseminate data products. The platform evolved as a core service for JRC scientists to produce knowledge and insights in support of EU policy making.
EOS is the main storage system of the BDAP for...
Fermilab has been running an EOS instance since testing began in June 2012. By May 2013, before becoming production storage, there was 600TB allocated for EOS. Today, there is approximately 13PB of storage available in the EOS instance.
The LPC cluster is a 4500-core user analysis cluster with 13 PB of EOS storage. The LPC cluster supports several hundred active CMS users at any given...
Purdue University switched to EOS storage a couple of years back, and we are still exploring/appreciating the benefits of this distributed file-system. In this talk we will give a brief status report and will outline our plans for using EOS at the CMS Tier-2 center at Purdue.
The
Joint Institute for Nuclear Research (JINR) utilizes a diverse
storage ecosystem, encompassing a number of dCache, EOS and Ceph
storage instances to address varied scientific needs. In this report
we focus on one of the largest EOS instances at JINR, operational
since 2019 as a shared storage system for experimental data.
Presently, it has the capacity of 22 PB and hosts over 7 PB of...
The presentation will summarize plans of the EOS team for 2024 and beyond.
