Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rag-ai-backend-embeddings-openai: configurable URL of the openai endpoint #1469

Open
neurohrer-mms opened this issue Jul 10, 2024 · 4 comments
Labels
kind/enhancement New feature or request

Comments

@neurohrer-mms
Copy link

Feature Suggestion

to connect to some selfhosted or connecting to a openai compatible endpoint we need to have a possibility to add this url in the config (optional).

Possible Implementation

  1. add optional value to configuration
  2. pass the configuration to the OpenAI see https://js.langchain.com/v0.2/docs/integrations/text_embedding/openai
@neurohrer-mms neurohrer-mms added the kind/enhancement New feature or request label Jul 10, 2024
@fjudith
Copy link
Contributor

fjudith commented Aug 21, 2024

Hello @neurohrer-mms ,

I'm currently looking to develop a similar feature, but the langchain LangchainJS library does not seems to support endpoint customization embbedings.ts, BUT the OpenAI version does embeddings.py.

@neurohrer-mms
Copy link
Author

neurohrer-mms commented Aug 21, 2024

i think it does. the baseURL property of the configuration parameter (type is ClientOptions). https://v02.api.js.langchain.com/interfaces/_langchain_openai.ClientOptions.html

https://js.langchain.com/v0.2/docs/integrations/text_embedding/openai/#custom-urls

@vmahe35
Copy link

vmahe35 commented Sep 30, 2024

Hello,
I am also interested by this feature because I am using a self hosted embeddings with OpenAI compliant interface (provided via VLLM).
Thanks

@pc-bob
Copy link
Contributor

pc-bob commented Oct 30, 2024

This should be complete now @punkle

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants