ATLAS SRM v2.2 test details

from ATLAS DM meeting 13/7/2007

The tests of SRM 2.2 from ATLAS will consist of:

1. Throughput exercise: data are created and written into CASTOR at CERN via RFIO using the SRM v2.2 CASTOR endpoint from the T0 Management System. They are registered in CERN LFC using an SRM v2 compatible namespace. Data are then moved from CERN to T1s SRM v2 test instances via the pilot FTS 2.0 service and stored in T1D0 and T0D1 classes at T1s. The data are also registered in the LFC of the T1s.
2. Test of Prodsys (distributed production) and Ganga (distributed analysis): the full chain event generation + simulation + digitization + reconstruction + analysis is tested at a designated Tier (could be T1 or T2) with an available SRM v2 endpoint. Production jobs at each stage of the chain read from the SRM 2.2 SE the input produced by the previous stage (except evgen) and produce one or more output files which are uploaded into the SRM 2.2 instance. Everything happens at the same site. The file I/O must be tested via lcg_utils for production jobs and both via gfal and native SE protocols for analysis jobs. Dynamic space reservation and pinning/releasing functionalities will be exercised.

Aim: Test all data flow scenarios in ATLAS exploiting the full set of SRM v2 functionalities.

• The exercise will be carried out with computing resources available in the WLCG production infrastructure. Therefore the sites providing storage involved in the tests should publish their SRM v2 test endpoint in the WLCG production BDII. They should not publish any SRM v1 service for those test instances. Flavia Donno

• ATLAS will prepare its software environment to deal with space token descriptions. This will be done by the end of August 2007 including tests.

• Negotiate with the CASTOR team at CERN on the resources needed for this exercise. This will be done through the WLCG ECM.

• Setup FTS 2.0 channels in the pilot FTS service between the CERN CASTOR SRM v2.2 instance and the other Tier-1 SRM v2.2 sites. Flavia Donno

• Move the current functionality of stager to SRM 2.2, including small scale tests. This will be done by the end of August - Miguel Branco

• Workflow for processing jobs

-- FlaviaDonno - 13 Jul 2007