In this talk we give a brief overview of the successful migration to the new namespace. Practically all EOS instances at CERN are currently on QuarkDB, the new namespace is officially boring technology, and MGM boot time a distant memory.
We will also discuss future plans and ideas to further improve scalability and performance of the namespace in particular with respect to locking,...
From EOS version 4.5. to 4.6. the need to read-lock listings has been changed. This presentation will explain why that matters!
Being the foundation and main component of numerous solutions employed within the WLCG collaboration, most notably the EOS storage system, XRootD grew into one of the most important storage technologies in the High Energy Physics (HEP) community. With the upcoming major release (5.0.0), the XRootD framework will not only bring functional enhancements and a TLS based, secure version of the...
This will be a status update about the eosxd implementation status and recent evolution.
Lessons learned from releasing EOS for CentOS 8.
This presentation will show the steps and difficulties encountered when moving the build and testing infrastructure to a new platform.
Presentation about the new FSCK functionality.
This is a short talk to give the status of our High-available Samba setup in front of CERNBox/Eos.
Deployed in production in September 2019, its role is becoming more and more critical as a larger Windows-based user community moves to CERNBox, following the planned phase-out of DFS at CERN.
XDC is a 2-year R&D project involving multiple EU partner institutes.
Within it's second year, developed EOS features revolve around QoS.
The presentation will showcase QoS classes, file conversions,
a rework of the Converter Engine and how they all tie together.
The current EOS version (Citrine v4.6.8) supports access to Windows clients using the Samba interoperability suite. As Samba is just an additional layer between EOS on Linux and Windows clients, it is an additional possibility for unexpected issues:
1. Access and data transfer speed
2. Problems with access/read/write file and directories
3. Problems with ACLs
4. Filename issues
This presentation will summarize a new buzz technology in WLCG. In January 2020 during a hackathon at CERN the major steps to enable this technology in WLCG have been done. The talk will briefly compare the WLCG token model to the native EOS token model and discuss how WLCG token support can be enabled for HTTP(S) and XRootD access.
Configuration setup and guidelines for TPC support with delegated certificates and tokens.
The File Transfer Service (FTS) is distributing the majority of the LHC data across the WLCG infrastructure and, in 2019, it has transferred more than 800 million files and a total of 0.95 exabyte of data. It is used by more than 25 experiments at CERN and in other data-intensive sciences outside of the LHC and even outside of the High Energy Physics domain. This brief talk will cover the work...
Data science and other communities have moved a lot of their workloads to web based applications, with notebooks being one of the most popular ways to perform data analysis or machine learning. In the same way, large scale computation services are often offered via web portals with similar requirements for authentication and authorization.
End users use SSO to access the frontend...
Comtrade is the member of CERN openlab and the important aim of such a membership is the integration of knowledge and experiences from CERN as a research institution and Comtrade as an industry partner.
What are the most valuable benefits of this collaboration for CERN:
a. New technologies and prototypes
b. Access and use of the research environments that are corner cases of industrial...
An overview of how to build and run EOS with code coverage support,
The EOS CI setup is used as an example of how to run an EOS cluster
and aggregate a final code coverage report.
An overview of the EOS CI nightly build setup.
Topics such as multiple build platforms and compiler sanitizers will be shown, together with examples of what the nightly build discovered.
Development work-flows and quality assurance of tagged releases are of pivotal importance in any large scale software project environment.
In this presentation we follow-up on the evolution of the CI operations, where we explored the opportunity to deploy EOS on top of Kubernetes, consolidated a seemless autonomous setup workflow and exploit distributed virtual clusters to perform the...
One of the key components of the XRootD software framework is the C++ implementation of the XRootD client. As the foundation of client binaries, XRootD Posix API and the Python API, it is also widely used on the server side in EOS and XCache. In order to facilitate future developments the XRootD client API has been extended to be in line with modern C++ programming practices.