Would be easy to make it work locally with Ollama ?

[Asir29]

What will be the challenges in making it work with a local configured model like Ollama ?

[swansonk14]

I think it should be possible! The main challenge would be to replace the API calls to the OpenAI API with Ollama API calls. If you're interested in adding Ollama as an option, please feel free to submit a PR!