Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add LiteLLMVectorizer to allow more embeddings to be used #1240

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

hawktang
Copy link
Contributor

@hawktang hawktang commented Jul 3, 2024

With LiteLLM proxy, the embedding model that LiteLLM supported can be used in DSPY

@arnavsinghvi11
Copy link
Collaborator

Thanks for opening this PR @hawktang . just curious, where is the LiteLLMVectorizer being used? seems to me it is just using the openAI embeddings but just wanted to double-check here.

@hawktang
Copy link
Contributor Author

Sorry for the late relay, I am on travel now.

LiteLLMVectorizer is used to call embedding models which LiteLLM proxy supported.

LiteLLM proxy is used to call different LLM APIs using the OpenAI API format.

With LiteLLM adaptor DSPY can direct support all the cloud and local model LiteLLM supports.

Because it is using OpenAI API format, LiteLLMVectorizer I wrote is quite similar except the base_url

Directly add base_url as parameter for openAI embeddings can achieve the result.

I will raise another PR if LiteLLMVectorizer class is redundant.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants