4–8 Nov 2019
Adelaide Convention Centre
Australia/Adelaide timezone

CERN Tape Archive: production status, migration from CASTOR and new features

7 Nov 2019, 11:45
15m
Riverbank R8 (Adelaide Convention Centre)

Riverbank R8

Adelaide Convention Centre

Oral Track 4 – Data Organisation, Management and Access Track 4 – Data Organisation, Management and Access

Speaker

Eric Cano (CERN)

Description

During 2019 and 2020, the CERN tape archive (CTA) will receive new data from LHC experiments and import existing data from CASTOR, which will be phased out for LHC experiments before Run 3.

This contribution will present the statuses of CTA as a service and of its integration with EOS and FTS and the data flow chains of LHC experiments.

The latest enhancements and additions to the software as well as the development outlook will be presented. With the development of the repack function, a necessary behind-the-scenes feature, CTA can now take over custodial data and handle media migration, compaction and failures. Further metadata handling optimizations allowed doubling the maximum file rate performance to 200Hz per queue.

New retrieve scheduling options are being developed at the request of experiments, with optional FIFO behavior to ensure better control of the timing for datasets retrieve, and fair share support for competing activities within the same VO.

Support for multiple backend databases (Oracle, PostgreSQL, MySQL) have been developed at CERN and contributed by external institutes.

This contribution will also report on the challenges of and solutions for migrating data from the decades old CASTOR to CTA. The practical example of the preparation for the migration of Atlas data will be presented.

Consider for promotion Yes

Authors

Co-authors

Viktor Kotliar (National Research Centre Kurchatov Institute (RU)) Tao Lin (Institute of High Energy Physics, CAS)

Presentation materials