Status of assigned tasks Room: 31/S-028 We will discuss the progress on the following tasks: * Check if we can obtain more information using Spark listeners than the one provided by the Spark REST API. * It seems that the Spark REST API only provides information about code for stages, and it is not user code but rather a stack trace of a Spark action. Check what we get with more complex programs (map-reduce instead of just a count). * Implement a Spark listener in Scala + Python that is fired when a new job starts. When that happens, the corresponding display should appear in the output of the right cell (the one that triggered the job). * Investigate more the communication frontent -> kernel. The kernel can be interrupted and then asked to stop the job, but this makes the kernel hang sometimes. Try to see if the control channel can be used for this communication and a thread can inspect it without inspecting the shell channel, otherwise try to implement a custom communication. * First implementation of the display, requireJS.

Contribution to Jupyter-Spark Room: 31/S-028 Discuss the answer of the Jupyter team about our collaboration in the project.

AOB Room: 31/S-028