Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ollama provider - Host input parameter is provided as secret field. #1563

Closed
sangee2004 opened this issue Jan 31, 2025 · 8 comments
Closed
Assignees
Labels
admin-ui UI related issues bug Something isn't working

Comments

@sangee2004
Copy link

Steps to reproduce the problem:

  1. Install ollama server locally and make it available using ngrok (ngrok http 11434 --host-header="localhost:11434")
  2. Using Ollama model provider , configure this provider by using host as https://<ngrok ipaddress>

Notice the following Host input parameter is provided as secret field.

Image

Expected Behavior:

  1. Host input parameter should not be provided as secret field.
  2. Helper text can be altered to not call out ip address.
@sangee2004 sangee2004 added admin-ui UI related issues bug Something isn't working labels Jan 31, 2025
@cjellick
Copy link
Contributor

@iwilltry42 can you address this?

@thedadams does our framework support this?

@thedadams
Copy link
Contributor

No, but it will after I implement the changes we discussed today.

@iwilltry42
Copy link
Contributor

This will be included in the model-provider metadata refactoring #1538

@iwilltry42
Copy link
Contributor

@sangee2004

Helper text can be altered to not call out ip address.

What would you want/expect to see here?
Just call it "Host" instead of "IP" in the help text?

@sangee2004
Copy link
Author

@iwilltry42 Yes. currently the helper text is IP Address for the ollama server (eg. 127.0.0.1:1234) . Example also suggest it being specified as ip address which can be changes as well.

@iwilltry42
Copy link
Contributor

Changed in #1538.
To clarify though - this can very well be just IP:PORT like in that example before.
In fact, when running both Ollama and Obot locally, you would put 127.0.0.1:11434 there.

@sangee2004
Copy link
Author

When testing local docker installs , we are not able to use localhost or 127.0.0.1 directly . This may need extra configuration that needs to be done on the docker install. So i ended up using ngrok to make is available publicly.

@sangee2004
Copy link
Author

Host input parameter is now presented in clear text.
Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
admin-ui UI related issues bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants