CTA Dev Meeting

Friday Mar 10, 2023, 3:00 PM → 4:30 PM Europe/Zurich

513/R-068 (CERN)

Michael Davis (CERN)

3:00 PM → 3:10 PM CTA Release Roadmap

See CTA Release Roadmap

Release 4.8.6-0.rc1

• Release date: 24 Feb
• Pre-prod deployment date: TBD
• Prod deployment date: NOT
• Test encryption key ID changes performed by Vova
• Issue link

Release 4.8.6-1

• Release date: 8 Mar
• Pre-prod deployment date: 9 Mar
• Prod deployment date: 9 Mar
• Small release from branch "release_4.8.6"
• Fixed queue cleanup bug in CTA
• Milestone link

Release 4.8.7-1

• Release date: TBD
• Pre-prod deployment date: TBD
• Prod deployment date: TBD
• Milestone link

Public Release

• Latest version available on public repo: v4.7.14-1, v5.7.14-1
• For release v4.8.6-1/v5.8.6-1, wait one week to see if the production deployment has been stable.

Release 4.8.6-0.rc1

• It has been released
• Vova will deploy to pre-production and test.

Release 4.8.7-1

• We need to find a fix to the "no tape block movement" warning (previously error) message before doing this release. It was a regression.

Public Release

• Will be done on top of the future release 4.8.7-1, as long as it works well for around a week.

3:10 PM → 3:20 PM CTA dev topics

Solution to count and monitor log events in CTA

• Discuss solution presented in #266

Allow VO override for repack

• For more details #31.

Review error messages for prepare abort

• Discuss solution presented in #ops-1008

Unify permission configuration across different CTA tools

• For more details 913#note_6509291.

"Needs discussion" topics

• Issues link

"Dev issue needed" topics

• Ops issues link

Solution to count and monitor log events in CTA

• Adopting OpenTelemetry can be a risk (vs the option of creating our own mechanism).
• In addition, we may not need all the complexity that it provides.
• Task 1: Select 1 or 2 use cases.
• Task 2: Check which infrastructure would need to be used.
• Task 3: Experiment and prototype on a separate branch. Have a POC.

Allow VO override for repack

• We will call the new column IS_REPACK_VO.

Review error messages for prepare abort

• We need to find ways to improve our error messages returned with query prepare.

Tasks:

• Add new fields to the file xattrs that help improving the "error_text" message in the query prepare command (For example "[123456789.00][cta-taped] trigger workflow - synchronous workflow failed"). Examples:
  • Timestamp
  • Message type
  • Message origin (cta-taped, cta-frontend, EOS, ...)
  • Etc...
• Check existing xattrs.
• Review default "error_text" messages filed by EOS. Check if they are adjusted to each specific scenario.
• Review mechanism that passes messages from CTA to EOS (&mgm.errmsg= field).

Unify permission configuration across different CTA tools

• Needs more investigation.

3:20 PM → 3:30 PM Scheduler DB

Handover from David to Jaroslav

• David will share with the team the architecture choices for the new Postgres Scheduler DB.

3:30 PM → 3:40 PM dCache Integration

AOBs

Fons and Michael have started working on the refactoring of the cta-frontend, to remove any duplicated code between the EOS and dCache versions,

3:40 PM → 3:50 PM CTA dev board review

Objective

• Look at the active issues in our CTA dev board.
• Decide if they should be kept, removed, reassigned, prioritised, etc.

Review unlabelled issues

• Unlabelled issues list: link

Review "In progress" issues

• Full CTA board: link

Review specific topic

• Every week we review the issues of one topic.
• This week: "Scheduler" and "Object Store" labels

3:50 PM → 4:00 PM AOB

Other

• Room 513/R-068 is booked every week, until the EOY, for the CTA dev meeting.

Next meeting will be on Thursday.