This was an experimental development inspired by the fact that there is a lot of data stored as PDFs and analyzing that data is far from being a trivial task. We started experimenting with a slightly easier task than analyzing PDFs, namely question answering based on PDFs. 

We used the popular langchain package. SentenceTransformers was used for identifying relevant text passages that were then fed to GPT-SW3 for constructing the final answer. We used custom prompts and also tried prompt-tuning GPT-SW3 so that it would only base its answers on the available context but noticed that the models were nevertheless hallucinating a lot. 

We decided that it was necessary to understand model hallucinations better before continuing with that project which is why that sub-project was not completed. We are still working on trying to improve our understanding of model hallucinations.