Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Request]: Open AI URL as a parameter #26

Open
shuther opened this issue Mar 8, 2024 · 1 comment
Open

[Request]: Open AI URL as a parameter #26

shuther opened this issue Mar 8, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@shuther
Copy link

shuther commented Mar 8, 2024

I would like to use self hosted llm with the plugin.

Describe the solution you'd like
If the URL to the openAI could be specified as well as the model name (free text), I would use Litellm, Ollama or other compatible solutions.

@shuther shuther added the enhancement New feature or request label Mar 8, 2024
@ericrallen
Copy link
Member

Hey there!

Thanks for the feature request. This has been on my long list of todos for a bit now, but I'll move it to the top as it should be pretty easy to implement.

I'll try to get a new version out that implements this very soon.

I initially tried to get #17 working by getting the core project to adopt Network Discovery, but that ran into a wall, and I forgot to circle back and implement the simplest approach, which is possible now that Ollama has an OpenAI-compatible endpoint.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants