CTA Dev Meeting

Friday 30 Sept 2022, 10:30 → 12:00 Europe/Zurich

31/S-028 (CERN)

Michael Davis (CERN)

10:30 → 10:40 CTA Release Workflow

• Release procedure instructions

10:40 → 10:50 CTA Release Roadmap

See CTA Release Roadmap

Release 4.7.11-1

• Milestones link
• Release date: 16 Sep
• Pre-prod deployment date: 26 Sep
• Prod deployment date: 29 Sep
• "Flush" all the latest main commits into a code release.

Release 4.8.0-1

• Milestones link
• Release date: TBD
• Pre-prod deployment date: TBD
• Prod deployment date: TBD
• v4.8.0-0.rc2 will be released and deployed in preproduction for testing purposes: #ops-842

Future releases (4.7.x)

• Milestones link

Public Release

• Remaining tasks
• Release date: Sep 2022
• On top of internal release v4.7.11
• Include Xrootd 5
• Versioning same as internal release, but with v5 (v5.Y.Z)

Public release:

• Joao will check with Julien how this will be done.

Other:

• Julien: we need to define a procedure with all the tests that we want to run in pre-production for every new release. A ops issue will be created by Julien for this.

10:50 → 11:00 Collaborations

CTA read support for non-native tape formats (OSM/dCache and Enstore)

• Project roadmap: #2
• [Jorge]: Handling of the non-native formats by the CleanerSession (#122). Overview.

cta-frontend-grpc integration for CTA

• Project roadmap: #38
• [Michael] Frontend refactoring:
  * Integrate cta-frontend-grpc with the common code.
  * Add support for the cta-admin commands that to not require response.
  * Pick one cta-admin streaming command as proof of concept.

11:00 → 11:10 CTA dev topics

Tape drive states

• [Vova]: Project status overview. Testing.

PostgreSQL scheduler DB

• [David]: Project status overview.

REPACKING tape state and queue cleanup

• [Joao]: Project status overview.
• Reintroduce 'force_disabled_tape' for backward compatibility.

EOS report logs

• [Joao/Julien]: Project status overview. Testing new EOS version with CTA.

cta-admin build for CentOS Stream-8, and other CI changes

• [Jorge/Julien]: Project status overview #72. Deployment of cta-admin binaries.

MHVTL repackaging for CERN CTA

• [Jorge] Ops issue link #ops-873
• Repackage MHVTL with a configuration that matches the the tapes & drives commonly used with CTA. Check configuration with Vlado.

Encryption key script optimization (cta-get-encryption-key)

• Issue description #Ops-839. Main tasks:
• [Joao]: Add the column Key ID to the table TAPE_POOL #137
• [Richard]: Modify cta-get-encryption-key script to accept the Key ID, instead of using cta-admin #138
• [Vova]: Modify Tape Server code to pass the Key ID to the script #139

Tool to change storage class of data written to tape, and cmd line tools refactoring

• [Lasse] Project status overview.

"needs discussion" topics

• Issues link

General:

• For the next dev meeting, we will just focus on ongoing issues that are flagged for discussion. It was discussed that the purpose of the dev meeting is not to report on ongoing progress, but to discuss dev issues between the team with the purpose of coming up with decisions.

Problem with m_maxBatchBytes logic in RecallTaskInjector:

• The task injector will be invoked at different points (N/2, 10, 1, 0), which guarantees that the driver is not left out of requests: link

Refactor Catalogue and RdbmsCatalogue classes:

• Jorge will only focus in implementing forward declaration in Catalogue.hpp. This should improve compilation times.

11:10 → 11:20 AOB

HTTP REST API, Activities and Priorities

• [Julien]: Specification document status and remarks. Scheduled discussion between CTA devs and FTS team.

Other

• Room 513/R-068 is booked every week, until the EOY, for the CTA dev meeting.