-
Andreas Joachim Peters (CERN)2/2/17, 9:30 AM
An Introduction to the EOS workshop.
Go to contribution page -
Andreas Joachim Peters (CERN)2/2/17, 9:35 AM
This is a quick recap of the EOS community, a who-is-who and our communcation platforms.
Go to contribution page -
Andreas Joachim Peters (CERN)2/2/17, 9:40 AM
This presentation will give a brief introduction to EOS and the Aquamarine release version.
Go to contribution page -
Herve Rousseau (CERN)2/2/17, 9:55 AM
This presentation summarizes the current EOS service deployment at CERN.
Go to contribution page -
Luca Mascetti (CERN), Jakub Moscicki (CERN), Hugo Gonzalez Labrador (CERN)2/2/17, 10:30 AM
Introduction to the CERNBox Service at CERN for those who do not know it yet.
Go to contribution page -
Giuseppe Lo Presti (CERN)2/2/17, 10:50 AM
The Web Application Open Platform Interface (WOPI) protocol allows to integrate collaborative editing with Office Online applications in CERNBOX/EOS.
Go to contribution page -
Mr David Jericho (AARNet)2/2/17, 11:00 AM
Impressed by CERN’s EOS filesystem providing a POSIX-like capability on top of a tried and tested large scale storage system, AARNet runs multiple EOS clusters, the most interesting being a three site single namespace running replicas across 65ms. This filesystem is used for user data delivered via ownCloud, FileSender and an internally developed tool for fast parallel bundled uploads.
Go to contribution page
... -
Mr Armin Burger (European Commission Joint Research Centre), Mr Veselin Vasilev (European Commission Joint Research Centre)2/2/17, 11:20 AM
The Copernicus Programme of the European Union with its fleet of Sentinel satellites will generate up to 10 terabyte of Earth Observation (EO) data per day once in full operational capacity. These data, combined with other geo-spatial data sources, form the basis of many JRC knowledge production activities. In order to handle this big amount of data and their processing, the JRC Earth...
Go to contribution page -
Gianluca Cerminara (CERN), Andreas Pfeiffer (CERN), Giovanni Franzoni (CERN)2/2/17, 11:45 AM
A wide range of detector commissioning, calibration and data analysis tasks is carried out by members of the Compact Muon Solenoid (CMS) collaboration using dedicated storage resources available at the CMS CERN Tier-2 centre.
Go to contribution page
Relying on the functionalities of the EOS storage technology, the optimal exploitation of the CMS user and group resources has required the introduction of policies for... -
Dr Michal Kamil Simon (CERN)2/2/17, 1:30 PM
XRootD is a distributed, scalable system for low-latency file access. It is the primary data access framework for the high-energy physics community and the backbone of EOS. One of the latest developments in the XRootD client has been to incorporate metalink and segmented file transfer technologies. We also report on the implementation of the signed requests and ZIP archive support.
Go to contribution page -
Andreas Joachim Peters (CERN)2/2/17, 1:45 PM
We will review our experience from 5 years of EOS in production and introduce a generic architectural evolution.
Go to contribution page -
Elvin Alin Sindrilaru (CERN)2/2/17, 1:55 PM
EOS namespace on top of a key-value store
CERN has been developing and operating EOS as a disk storage solution successfully for over 6 years. The CERN deployment provides 140 PB of storage and more than 1.4 billion replicas distributed over two computer centres. Deployment includes four LHC instances, a shared instance for smaller...
Go to contribution page -
Georgios Bitzes (CERN)2/2/17, 2:15 PM
quarkdb will soon become the storage backend for the EOS namespace. Implemented on top of rocksdb, a Key-Value store developed by Facebook, quarkdb offers a redis-compatible API and high availability through replication.
In this talk, I will go through some design decisions of quarkdb, and detail how replication is achieved through the raft consensus algorithm.
Go to contribution page -
Geoffray Michel Adde (CERN)2/2/17, 2:35 PM
The CITRINE release provides a completely re-engineered scheduling algorithm for geographic-aware file placement. The presentation will highlight key concepts of scheduling tree, proxy groups, file sticky-ness ...
Go to contribution page -
Andreas Joachim Peters (CERN)2/2/17, 2:55 PM
During 2016 the usage and scope of EOS at CERN and outside has been evolving towards usage as a POSIX like filesystem. The presentation will highlight the current state and improvements done during the last year. We will introduce the next generation (reimplementation) of the FUSE client in EOS which might overcome most limitations and non POSIX behaviour adding dedicated server side support...
Go to contribution page -
Geoffray Michel Adde (CERN)2/2/17, 3:15 PM
We have added a similar mechanism as AFS/Kerberos to bind user applications to user credentials when interacting with EOS over FUSE. In this presentation we will describe the implementation and its integration into the login mechanism in interactive and batch nodes at CERN.
Go to contribution page -
Dan van der Ster (CERN)2/2/17, 3:30 PM
This talk will present the devops workflow used to validate and deploy new eos-fuse releases to the CERN computing infrastructure.
Go to contribution page -
Martin Vala (Technical University of Kosice (SK))2/3/17, 9:00 AM
The goal of this talk is to share experience installing and using EOS storage at small cluster/sites for local users or students. Simple cluster setup contains FreeIPA (kerberos and ldap) as authentification with own Certificate authority, SLURM queuing system, CVMFS for software distribution, EOS as storage for data and home directories. For easy development and issue tracker GitLab is used....
Go to contribution page -
Lars Holm Nielsen (CERN)2/3/17, 9:20 AM
We will present our recent experiences with integrating EOS into [Invenio digital library framework][1] and how EOS allows data repository services such as [Zenodo][2] to handle large files in an efficient and scalable manner. Invenio v3, the underlying framework for a number of data preservation repositories such as [CERN OpenData][3], [CERN Document Server][4] and Zenodo, was completely...
Go to contribution page -
Haibo li (Institute of High Energy Physics Chinese Academy of Science)2/3/17, 9:40 AM
There are many large scientific projects in Institute of High Energy Physics (IHEP), such as BESIII, JUNO, LHAASO and so on. These experiments have a huge demand for massive data storage. EOS as an open source distributed disk storage system provides good solution. IHEP now has deployed two EOS instances. One is used for batch computing, and another for public usage (Owncloud+EOS). In this...
Go to contribution page -
Mr Andrey Kirianov (Petersburg Nuclear Physics Institut (RU))2/3/17, 10:00 AM
In our talk we will cover development and implementation of federated data storage prototype for WLCG centers of different levels and university clusters within one Russian National Cloud. The prototype is based on computing resources located in Moscow, Dubna, St.-Petersburg, Gatchina and Geneva. This project intends to implement a federated distributed storage for all kind of operations with...
Go to contribution page -
Andreas Joachim Peters (CERN)2/3/17, 11:00 AM
A brief introduction to the EOS workflow engine.
Go to contribution page -
Eric Cano (CERN)2/3/17, 11:10 AM
The CERN Tape Archive (CTA) will provide EOS instances with a tape backend. It inherits from the CASTOR's tape system, but will provide a new request queuing system which will allow more efficient tape resource utilization.
In this presentation we will present CTA's architecture and the project's status.
Go to contribution page -
Julien Leduc (CERN)2/3/17, 11:30 AM
The IT Storage group at CERN develops the software responsible for archiving to tape the custodial copy of the physics data generated by the LHC experiments. This software is code named CTA (the CERN Tape Archive).
It needs to be seamlessly integrated with EOS, which has become the de facto disk storage system provided by the IT Storage group for physics data.CTA and EOS integration requires...
Go to contribution page -
Andreas Joachim Peters (CERN)2/3/17, 11:50 AM
An introduction how to use the EOS REST API for management and user interfaces.
Go to contribution page -
Andrea Manzi (CERN)2/3/17, 11:55 AM
The talk describes a graphical interface under implementation to help administering an EOS cluster.
Go to contribution page -
Choose timezone
Your profile timezone: