Data Knowledge Catalog Meeting (TPU/NRC KI)

→ Europe/Moscow
Other Institutes

Other Institutes

Vidyo room
Marina Golosova (National Research Centre Kurchatov Institute (RU))
Description
Vidyo room 'DKB'
GitHub: PRs
Trello
Hide

DKB@ATLAS instance

Current status: OK
Known issues:

  • "connection refused" from AMI (daily, for a short period of time): check AMI client version.

Integration w/ BigPanDA Mon

Development status: 75% done (75% in production)

ToDo:

  • study time series storages for progress data:
    • Graphite;
    • InfluxDB.

Notes:

  • draw some pictures for "why ES isn't good enough for this purpose";
  • next time: move discussion on "what should be done" to JIRA.

Batch Processing

ToDo:

  • NDJSON comparison tool:
    • note: maybe use jq + diff, not some Python stuff?
  • carefully plan batch mode development (from current "non-supervised" to properly supervised workerk operation);
  • check if AMI has some more convenient response format than the one used now (complicated "technical" JSON).

DKB installation/development manual

ToDo:

  • move document to GitHub wiki or something like this;
  • pictures for Build a new instance;
  • Introduction;
  • Execution and support (rename?).

Papers (for Ivannikov WS)

Deadline: 2020-08-25

  1. Batch processing (vaulov)
  2. Storage scheme update (mgolosova)
There are minutes attached to this event. Show them.