- DC2 pipeline complete, but working with CM team to standardise the data return process
- The script to return data is hard-coded in places, which all rely on URI, which is currently incorrect
- Working on moving data to the correct location now
- Approx 4 million files
- writing a script to use multiprocessing with Python to move data
- Will run DC2 again with the weekly code from week 18 from Friday (1st May)
- And will continue to run every other week going forwards to assist with site and code base testing and troubleshooting
- After DC2 data return process complete will work on getting the RC2 data registered in a butler repository for smaller test but with pre-curser data
- LSST want to use a UK FTS for European transfers, so will want to either use SKA FTS or LCGFTS - or at least use it for fail over
- Not using a FTS for a time and wanting to use it for failover could lead to further failures
- Do ATLAS and CMS use a single central FTS for all transfers or do they also use geographically closest ones?
- From talking to other devs Rucio currently uses only the FTS related to the destination