All-In-Image Ltd. - EP-SFT Meeting

Europe/Zurich
Enric Tejedor Saavedra (CERN), Pere Mato Vila (CERN)

Participants: Avner, Ron, Pere, Omar, Enric

Omar described a proposal to implement a microservices architecture based on a Flask server that uses Jupyter Kernel gateway to publish notebooks as microservice endpoints. Omar also talked about an IBM solution, now made open source, called Jupyter Enterprise Gateway, which is the evolution of Jupyter Kernel Gateway and could be investigated.

As for the feedback from Avner and Ron, Omar will investigate the following points in the new Jupyter Kernel Gateway:

- How are microservices updated? If a notebook changes, can we automate the update of the corresponding microservice in our infrastructure? How long does that operation take? Updating a microservice should not imply restarting the whole server that deploys the microservices.

- Microservices should be able to take multiple parameters when being invoked. Furthermore, there should be a mechanism in place to check for the correctness of such parameters.

- Asynchronous jobs: is there a way to launch a long-running microservice, get a job id or similar from the server, and periodically check if the execution of that microservice finished?

- How are permissions of users enforced by the system?

- In general, what are the benefits that this new IBM solution can bring vs a custom solution for implementing the microservices architecture?

 

Besides the microservices discussion, a few more points were tackled:

- What is the status of the interaction with Openlab? EP-SFT will ask Danilo.

- Omar will ask for the account usernames of Avner and Ron, so that they can be added to the list of users that can access the gitlab repository with the code of Omar.

- Omar will explain to Avner and Ron how to connect to lxplus as a first step to access internal machines in the CERN network.

There are minutes attached to this event. Show them.
    • 14:00 14:10
      Introduction 10m
    • 14:10 14:40
      Status of development 30m
      Speaker: Omar Andres Zapata Mesa
    • 14:40 14:50
      AoB 10m