You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I would like to use self hosted llm with the plugin.
Describe the solution you'd like
If the URL to the openAI could be specified as well as the model name (free text), I would use Litellm, Ollama or other compatible solutions.
The text was updated successfully, but these errors were encountered:
Thanks for the feature request. This has been on my long list of todos for a bit now, but I'll move it to the top as it should be pretty easy to implement.
I'll try to get a new version out that implements this very soon.
I initially tried to get #17 working by getting the core project to adopt Network Discovery, but that ran into a wall, and I forgot to circle back and implement the simplest approach, which is possible now that Ollama has an OpenAI-compatible endpoint.
I would like to use self hosted llm with the plugin.
Describe the solution you'd like
If the URL to the openAI could be specified as well as the model name (free text), I would use Litellm, Ollama or other compatible solutions.
The text was updated successfully, but these errors were encountered: