CTA Dev Meeting

Thursday Mar 30, 2023, 2:00 PM → 3:30 PM Europe/Zurich

513/R-068 (CERN)

Michael Davis (CERN)

2:00 PM → 2:10 PM CTA Release Roadmap

Release 4.8.7-1

• Release date: 29 Mar
• Pre-prod deployment date: 29 Mar
• Prod deployment date: 3 Apr
• Milestone link

Public Release

• Latest version available on public repo: v4.7.14-1, v5.7.14-1
• Next public release: v4.8.7-1/v5.8.7-1, if deployed in prod for 1 week without issues

2:10 PM → 2:20 PM CTA dev topics

Collect metadata field from the HTTP TPC command

• For more details: #299

Tapes get stuck PENDING states if there is no queue in the object store

• For more details: #258

Reduce the number of queues fetched in fetchMountInfo

• For more details: #285

"Needs discussion" topics

• Issues link

"Dev issue needed" topics

• Ops issues link

Collect metadata field from the HTTP TPC command

• We decided to separate this work into 3 separate topics, which can be seen in the issue. They can be split into separate issues, so that multiple people work on it.
• We need to discuss how the metadata is going to be sent from EOS to CTA. Should we pass it as a single json string, or multiple protobuf fields? If we pass as json, should we modify the original object, or pass it transparently?

Reduce the number of queues fetched in fetchMountInfo

• Created new ticket with fresh description. Not assigned to anyone for now.

The RAO list contains duplicate entries of files to retrieve

• Issue identified by Jacek, when CTA is used together with dCache: https://gitlab.cern.ch/cta/CTA/-/issues/346
• He noticed that the RAO list has duplicated retrieve jobs on the same file.
• At CERN we are protected from this because request duplication is managed by EOS. dCache does not have the same protection.
• Michael will investigate what can be done on the objectstore/RAO side to remove duplicates.

2:20 PM → 2:30 PM dCache Integration

AOBs

2:30 PM → 2:40 PM PostgreSQL SchedulerDB

Presentation by David

ctadev_pscheddb_update_30mar23.pdf

ctadev_pscheddb_update_30mar23.pptx

2:40 PM → 2:50 PM AOB

Other

• Room 513/R-068 is booked every week, until the EOY, for the CTA dev meeting.
• Next meeting on 14th April, chaired by Vova.

2:50 PM → 3:00 PM CTA dev board review

Objective

• Look at the active issues in our CTA dev board.
• Decide if they should be kept, removed, reassigned, prioritised, etc.

Review "Assigned" labeled issues

Full CTA board: link

• Harmonize retrieve/recall reporting interface for success. #40
• Revise the cleanup logic of the tapeserver #50
• Do not queue file for retrieve if EOS size/checksum do not match CTA Catalogue #75
• Testing format import for tests #45
• CI compatible with recent kubernetes versions #32
• dbunittests_oracle CI jobs are timing out and silently failing #66
• Put in place automatic container registry cleanup #84
• quarkDB xrootd must come from eos-xrootd package #60

Review unlabelled issues

• Unlabelled issues list: link

Review "In progress" issues

• Full CTA board: link

Review specific topic

• Every week we review the issues of one topic.
• This week: "Scheduler" and "Object Store" labels