Speaker
Description
Abstract: During the last year of LHC Run-3, several new records were set by the CERN Tape Archive (CTA) service at WLCG Tier-0: the rate of data archival to tape peaked at over 60 PB/month and the total volume of data grew to more than 1 Exabyte.
The CTA service was able to scale up to meet these demands thanks to architectural choices made prior to Run-3 as well as responses to specific operational problems encountered during the run. The architecture of CTA was a deliberate departure from the Hierarchical Storage Management (HSM) model of previous runs, but certain practices inherited from previous runs were addressed only as they had an operational impact.
This talk will explain both the architectural choices for CTA and the operational experience gained during Run-3. Topics covered will include hardware and systems architecture, I/O throughput planning, disk buffer management and specific operational mitigations. The talk is targetted at Tier-1 sites who will have to achieve similar tape archival performance during Run-4.
Speaker Bio: Julien Leduc is a Storage Engineer working at CERN's Storage and Data Management group and has more than 10 years of experience in diverse software defined storage platforms.
He has been the CERN Tape Archive service manager since the initial deployment of CTA software earliest versions and for LHC Run3.
Prior to joining CERN, he was working as a grid middleware developer and service manager for HPC systems at INRIA. At that time he was one of Grid5000 service architects: from early Grenoble prototype to nationwide research Grid and managed several HPC systems in the top500.
He enjoys tinkering with hardware too: designed and built a high flow dust sensor for tape libraries and worked on CERN Fluidic data artistic installation.
He is an enthusiast of open source and mostly worked in public research ecosystem that allow him to freely share his experience with interested communities.