Data Knowledge Catalog Meeting (TPU/NRC KI)

Thursday 30 Jul 2020, 11:00 → 12:00 Europe/Moscow

Other Institutes

Marina Golosova (National Research Centre Kurchatov Institute (RU))

Vidyo room 'DKB'

GitHub: PRs

Trello

DKB@ATLAS instance

Current status: OK
Known issues:

• "connection refused" from AMI (daily, for a short period of time): check AMI client version.

Integration w/ BigPanDA Mon

Development status: 75% done (75% in production)

ToDo:

• study time series storages for progress data:
  • Graphite;
  • InfluxDB.

Notes:

• draw some pictures for "why ES isn't good enough for this purpose";
• next time: move discussion on "what should be done" to JIRA.

Batch Processing

ToDo:

• NDJSON comparison tool:
  • note: maybe use jq + diff, not some Python stuff?
• carefully plan batch mode development (from current "non-supervised" to properly supervised workerk operation);
• check if AMI has some more convenient response format than the one used now (complicated "technical" JSON).

DKB installation/development manual

ToDo:

• move document to GitHub wiki or something like this;
• pictures for Build a new instance;
• Introduction;
• Execution and support (rename?).

Papers (for Ivannikov WS)

Deadline: 2020-08-25

1. Batch processing (vaulov)
2. Storage scheme update (mgolosova)

11:00 → 11:05 DKB services: status report & news

Current status of the DKB ATLAS instance.

Speakers: Marina Golosova (National Research Centre Kurchatov Institute (RU)), Viktor Kotliar (National Research Centre Kurchatov Institute (RU))

status report

11:05 → 11:25 Other business

• Pull Requests;
• 1-slide reports for current tasks;
• Paperwork;
• ToDo's;
• AOB

Speakers: Anastasiia Kaida (National Research Centre Kurchatov Institute (RU)), Marina Golosova (National Research Centre Kurchatov Institute (RU)), Vasilii Aulov (National Research Centre Kurchatov Institute (RU)), Viktor Kotliar (National Research Centre Kurchatov Institute (RU))

misc