CTA deployment meeting

Europe/Zurich
600/R-001 (CERN)

600/R-001

CERN

15
Show room on map
Michael Davis (CERN)

Getting LHCb into Production

  • Julien has deployed EOS v4.8.35 on EOSCTA LHCb, which contains fixes for XrdHttp.
  • Once HTTP is configured, Michael will coordinate tests of HTTP transfers with Chris Haen.

Getting PUBLIC into Production

  • Julien will configure PUBLIC spinner space (after HTTP for LHCb is done).
  • Vova will ping NA61/SHINE to see if they have decided on their DAQ solution (DTO + FTS was suggested) and to see if they are starting integration work and if they need any help from us.
  • Michael will contact Bartek (NA61) about his use case where experiment data is being put in his personal CASTOR area.
  • Knowledge Base article for users to access data in CTA: we will refine, configure and test the procedure for users to retrieve files from EOSCTA PUBLIC. Once we are happy, it will be documented in a KB article. (Issue #214)
  • Policy for users who tell us to delete old legacy data: we will not delete it. We will give users the permission to delete it themselves, or if this can't be done we will just store it indefinitely.
  • Issue #905 (GC not getting correct EOS space of files where file moves between spaces) has been resolved. We will test GC on the spinner space as part of the NA62 tests.

CTA Round Table

Recommended Access Order tests

  • Vlado will present his results to us on Friday.

Superseded replacement with recycle bin

  • Cedric has implemented this and it will be deployed in the next version.
  • We should test if we can recover a deleted file before Cedric goes.

Remove "prepare with no -s" from EOS MGM

  • It is safe to do this if we wrap it in "if tape enabled" logic.
  • Issue #953

Tape verification

  • The tape server needs to be able to recall a file from tape and check its checksum.
  • We need an update to our protocol to allow the option of recalling a file from tape but not send it anywhere.
  • See issue #883

CTA v4.0

  • Main features of CTA v4.0 are: superseding superseded, tape lifecycle, max mounts per VO.
  • New features are listed in the Release Notes. Going forward, we agreed to update the Release Notes as soon as we have committed a feature which will be added to the next release.
  • Cedric is writing scripts to test the update of the CTA schema in production. He will ask Sebastian Masson to create a clone of the CTA DB in castorint to test against. Additional local copies can be created for testing using "CREATE TABLE ... AS SELECT * FROM ..."

AOB

  • Eric's SchedulerDB/ObjectStore paper will be the only one we submit to CHEP this time around.
There are minutes attached to this event. Show them.
    • 14:00 14:10
      Getting LHCb into Production 10m

      TO DO

      • DAQ test : Niko Neufeld agreed the technical points with IT-CS before Christmas and they will do the necessary connections in the next days. Maria has added the DAQ test to Planning tests for LHCB Storage Run-3. Niko is back from holiday today (11/1/2021) so we can agree the schedule for these tests shortly.
      • Julien is setting up a HTTP gateway for EOSCTA LHCb, #209
      • Chris will test the FTS multi-hop (QoS change+transfer) in Dirac

      Schedule

      • w/c 11 Jan: test HTTP interface
      • (January) DAQ test
      • SARA: tested migration to new dCache last week, should be ready by end of Jan
      • IN2P3: needs to fix some dCache config issues, should be ready by end of Jan
      • (February) Publish OTGs
      • CASTOR LHCb to recall-only mode
      • CASTOR LHCb disabled
      • Migrate to CTA
      • EOSCTA LHCb in production
      • (March?) Data flow tests
    • 14:10 14:20
      Getting PUBLIC into Production 10m

      Ongoing Tests (Vova)

      • AMS: waiting for Baosong
      • CAST: ongoing this week
      • COMPASS: DAQ tests concluded (#69). Recall testing after the spinner space is configured.
      • DUNE: ongoing this week (#213)
      • NA61/SHINE: starting CTA integration this month?
      • NA62: Recall tests completed (#72). Re-test with spinner space. Migration date set for 22 February
      • n_TOF: test offline workflow with spinner space

      TO DO

      • Finish repack of public_user
      • "ALICE-like" spinner space on EOS PUBLIC PPS, to test with NA62 and n_TOF (#161)
      • Thu 14 Jan: Meeting with NA62
      • Knowledge Base article for users to access files in CTA
      • Migrate data from legacy experiments (Aleph, Chorus, Delphi, Nomad, Opal, ...).
    • 14:20 14:30
      CTA Round Table 10m
      • Vlado's RAO tests
      • GC not getting correct EOS space of files where file moves between spaces (#905)
      • Superseded replacement with recycle bin (#922)
      • Tape Lifecycle (#186, #943)
      • Remove "prepare" handling without "-s" from EOS MGM?
      • Tape verification in CTA (#883)
    • 14:30 14:35
      AOB 5m
      • Paper submission for CHEP
      • PJAS and Fellow candidates