Skip to content

Commit

Permalink
Update target models in demo deployment
Browse files Browse the repository at this point in the history
  • Loading branch information
cornzz committed Feb 8, 2025
1 parent 0afea2e commit 98a4cf0
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 2 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ LLM_TOKEN=token_1234
LLM_LIST=gpt-4o-mini, gpt-3.5-turbo # Optional. If not provided, a list of models will be fetched from the API.
SURVEY_MODE=false # Optional. If set to 1, survey mode is enabled, i.e. answers are returned in random order and feedback can be submitted by the user.
FLAG_PASSWORD=very_secret # Optional. If not provided, /flagged and /logs endpoints are disabled.
APP_PATH=/ # Optional. Sets the root path of the application, for example if the application is behind a reverse proxy.
APP_PATH=/compress # Optional. Sets the root path of the application, for example if the application is behind a reverse proxy. Do not set if the application is running on the root path.
```

## Running
Expand Down
4 changes: 3 additions & 1 deletion kubernetes/deployment.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -34,10 +34,12 @@ spec:
env:
- name: APP_PATH
value: /compress
- name: SURVEY_MODE
value: "true"
- name: CONSENT_POPUP
value: "true"
- name: LLM_LIST
value: meta-llama/Meta-Llama-3.1-70B-Instruct, CohereForAI/c4ai-command-r-08-2024
value: meta-llama/Llama-3.3-70B-Instruct, CohereForAI/c4ai-command-r-08-2024, Qwen/Qwen2-VL-7B-Instruct
# - name: HF_HUB_CACHE
# value: /demo/cache/huggingface
# - name: TIKTOKEN_CACHE_DIR
Expand Down

0 comments on commit 98a4cf0

Please sign in to comment.