Sprint 4 Summary

This sprint we made several smaller updates to Zensei.

We implemented the ability to reenter an existing thread in Slack at any time, allowing the user to continue any old conversation with Zensei long after the initial question. This was accomplished by fetching the conversation data from the thread and adding this to the chatbots history as well as reembedding the original question in the thread to retrieve the correct sources from the original thread. Due to the fact that we always retrieve our sources at a temperature of 0 the sources will be identical no matter how many times we embed the same question allowing the sources to be identical when reviving an old thread.

A lot more data was also added this week. This should improve answers to questions that did not generate correct answers earlier. We also simplified the process of fetching, cleaning and embedding the data to be able to update the data when necessary.

We deployed the Slack bot on a virtual machine to be able to run it continuously and it is now available for some employees to chat with. As of now it is mostly used to test and evaluate the chatbot.

The next steps are to evaluate the performance with the added data and to adjust the prompt and ranking of the sources based on that.