CTA deployment meeting

Monday 12 Jul 2021, 14:00 → 15:30 Europe/Zurich

600/R-001 (CERN)

Michael Davis (CERN)

14:00 → 14:10 Migration of CASTOR home directories

• OTG0064878 Closure of CASTOR home directories
• #390 Migration of CASTOR user accounts to CTA
• Experiment data has been separated from user data as far as possible. New fileclasses to distinguish between primary accounts, secondary accounts and service accounts. do_not_migrate fileclass for data which should probably be deleted.

Summary

• 971 CASTOR users. Around 1/3 of them have <100 files.
• total count of files: 61,765,238, total size: 4.9 PB
• 7 users with >100 TB. 246 users with >1 TB.
• Only around 20 users who wrote data to CASTOR in the last year. These seem to be mainly experiment analysis or MC use cases.

Strategy

1. Clean up/delete unneeded files where possible
2. Migrate users with <1 TB to CERNBox. Currently if we total up files for all users with <1 TB it comes to 76 TB.
3. Users with >1TB, 2 options:
4. let them negotiate a higher limit
5. leave their data on tape and migrate it to CTA (last resort)

To Do

• Need a policy for users who have left CERN and left files behind in CASTOR.

14:10 → 14:20 CASTOR Backup

• #307 Migrate CASTOR Backup use cases to CTA

Use cases

• EOS archive tool Migrated to CTA
• Messaging
• Oracle
• EOS
• Hadoop
• AFS (#282)
• Zvault (Microelectronics and NFS Filer)

14:20 → 14:30 Cold Data

• NA48 - #341 - repack underway
• r_public_misc: covers most of the rest of the small experiment use cases (single copy). Repacking will separate from r_public_user.
• r_public_user_[1,2] is other small experiment data (not user data despite the name of the tapepool), dual copy. Merged with r_lep_data_[1,2].

14:30 → 14:35 AOB

• IT-ST-TAB round table