Invenio Developer Forum 2014-12-08 Light Celery Workflows

Monday 8 Dec 2014, 16:45 → 17:45 Europe/Zurich

31/S-023 (CERN)

We'll discuss progress on running light workflows in Celery.

16:45 → 17:15 Light Celery Workflows

Speaker: Jan Age Lavik (CERN)

Summary of Light Celery Workflows discussion

* How to manage the current exception "signaling" in the 
  GenericWorkflowEngine.processing_factory()? Well, signals! By
  emitting signals that anyone can connect to in order to react
  to some event like Stop, Halt, Jump etc. Then in addition, we can
  follow standard "Flask exception" architecture to have mapping
  of exception -> generic loop handling.

* We will add an engine (subclassed from GenericWorkflowEngine) that
  interacts with Celery for allowing asynchronous execution by allowing the
  client to pass it's celery object so that tasks can be added to the workers.

* Code examples and more details will be revealed on the official RFC.

The discussion continues there!