Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
phact authored Jul 18, 2024
1 parent 1d816e2 commit 9ab94a3
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -178,9 +178,7 @@ you need to pull the model you want to ollama before using it

curl http://localhost:11434/api/pull -d '{ "name": "deepseek-coder-v2" }'

your assistants client should route to the ollama container by passing the llm-param-base-url header:

client = patch(OpenAI(default_headers={"LLM-PARAM-base-url": "http://ollama:11434"}))
your assistants client should route to the ollama container setting OLLAMA_API_BASE_URL. OLLAMA_API_BASE_URL should be set to http://ollama:11434 if you are using docker-compose. If you are using ollama on your localhost you can set it to http://localhost:11434


## Feedback / Help
Expand Down

0 comments on commit 9ab94a3

Please sign in to comment.