Focus on:  Hide Contributions
Login

CTA Dev Meeting

→ Europe/Zurich
513/R-068 (CERN)

513/R-068

CERN

19
Show room on map
Michael Davis (CERN)
    • 15:00 → 15:10
      CTA Release Workflow 10m
    • 15:10 → 15:20
      CTA Release Roadmap 10m

      See CTA Release Roadmap

      Release 4.7.9-2

      • Milestones link
      • Release date: 08 Aug 2022
      • Pre-prod deployment date: 09 Aug 2022
      • Prod deployment date: 10 Aug 2022

      Release 4.7.10-1

      • Milestones link
      • Release date: TBD
      • Pre-prod deployment date: TBD
      • Prod deployment date: TBD
      • "Flush" all the latest main commits into a code release.

      Release 4.7.11-1 - Catalogue v12.0

      • Milestones link
      • Release date: TBD
      • Pre-prod deployment date: TBD
      • Prod deployment date: TBD
      • New states (EXPORTED, etc.) and index changes.

      Release 4.8.0-1

      • Milestones link
      • Release date: End of Aug 2022
      • Pre-prod deployment date: End of Aug 2022
      • Prod deployment date: Sep 2022
      • v4.8.0-0.rc1 has been released and deployed in preproduction for testing purposes: #ops-842

      Future releases (4.7.x)

      Public Release

      • Remaining tasks
      • Release date: Sep 2022 (delayed)
      • Include Xrootd 5
      • Versioning same as internal release, but with v5 (v5.Y.Z).
      • The DB team has asked for the CPU load to be reduced as soon as possible (by fixing the DB indexes). Therefore we will release the Catalogue v12.0 first, as version 4.7.10. The code changes will come after.
      • The public release will be released on top of the future version 4.7.11. There is no need to wait for 4.8.x.
    • 15:20 → 15:30
      Collaborations 10m

      CTA read support for non-native tape formats (OSM/dCache and Enstore)

      • Project roadmap: #2
      • [Jorge]: Handling of the non-native formats by the CleanerSession: #122

      cta-frontend-grpc integration for CTA

      • Project roadmap: #38
      • Protobuf change discussion: #63
      • btime needs to be filled in by EOS (development on EOS): #86
      • The cta-frontend-grpc integration for CTA is blocked by the need to pass the `cta.common.Clock btime` from EOS to CTA (CTA is already prepared to receive it) - #86 
    • 15:30 → 15:40
      CTA dev topics 10m

      Tape drive states

      • [Vova]: Project status overview.

      PostgreSQL scheduler DB

      • [David]: Project status overview.

      Future improvement: cta-admin schedulinginfo subcommand

      • See #126.
      • Objective: Print the next tape(s) that will be mounted per logical tape library.
      • ATM this is not useful because the VID is not included. With the PostgreSQL scheduler DB, we should be able to easily add this!

      REPACKING tape state and queue cleanup

      • [Joao]: Project status overview.
      • Discuss all new states in a diagram (REPACKING, EXPORTED, etc...): Diagram link

      EOS report logs

      • [Joao]: Project status overview.

      cta-admin build for CentOS Stream-8, and other CI changes

      • [Jorge]: Project status overview #72

      archiveretrieve-eos5 failure

      • [David] Current status of #129 debugging. This seems to have been impacting our CIs for a while.

      Proposal to change EOS disk fid to fxid

      • [Michael] Present and discuss solution to #134.

      Temperature & humidity values collection from the tape drives

      • Discuss if Miguel script (#Ops-631) can be used to monitor these values and print them to a dashboard.

      cta-taped encryption ERROR when upgrading ctaproductionfrontend

      • Issue first presented here: #Ops-839
      • We can bypass the ctafrontend query by passing the Key ID directly from the tape server directly to the script.
      • This requires changing the script cta-get-encryption-key
         and defining a strategy for deployment.

      "needs discussion" topics

      REPACKING tape state and queue cleanup

      • A diagram containing all the new and old tape states was presented here.
      • The new states were accepted: REPACKING_DISABLED, EXPORTED, EXPORTED_PENDING.
      • REPACKING_DISABLED can only be changed to BROKEN or EXPORTED.
      • The diagram is good but can be improved: add dash lines to distinguish between mountable, temporary, queueable states, user-land, operator-land.

      Temperature & humidity values collection from the tape drives

      • It may be possible to ignore the humidity alerts (if spectra logic experts suggest so), but any decision to do so needs to be approved first by upper management. They are the ones that can make the decision based on the risk.
      • Julien will manage the work on the monitoring tool originally developed by Miguel and on the dashboards.
      • There will be a meeting next Monday with the datacenter operations to discuss possible solutions regarding the humidity issue.

      cta-taped encryption ERROR when upgrading ctaproductionfrontend

      • Only the Key ID will be passed from the Tape Server to the python script cta-get-encryption-key.
      • The work is split on 3 parts:
      1. Add the column Key ID to the table TAPE_POOL. We can use the same definition for the Key ID that exists in the table TAPE. This change should be included in the next catalogue version v12.0.
      2. The cta-get-encryption-key needs to be modified to accept the Key ID from the Tape Server and directly use it to obtain the Encryption Key, without using cta-admin command.
      3. The Tape Server code needs to be modified to pass the Key ID to the script.
    • 15:40 → 15:50
      AOB 10m

      HTTP REST API, Activities and Priorities

      • [Julien]: Specification document status and remarks.

      Other

      • No dev meeting on 9 Sep 2022.
      • Room 513/R-068 is booked every week, until the EOY, for the CTA dev meeting.
Powered by Indico v3.3.3-pre