Skip to content

Commit

Permalink
Update private-deep-chat.md
Browse files Browse the repository at this point in the history
  • Loading branch information
nstogner authored Oct 31, 2024
1 parent 62a1af5 commit c287c12
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions docs/tutorials/private-deep-chat.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Private Deep Chat

In this tutorial you are going to deploy a custom, multitenant, private chat application. The Chat UI is powered by <a href="https://deepchat.dev/" target="_blank">Deep Chat</a> - an open source web component that is easy to embed into any frontend web app framework or simple HTML page. KubeAI will be used to ensure that all chat interactions are kept private within the cluster.
In this tutorial you are going to deploy a custom, multitenant, private chat application. The Chat UI is powered by <a href="https://deepchat.dev/" target="_blank">Deep Chat</a> - an open source web component that is easy to embed into any frontend web app framework or simple HTML page. KubeAI, which serves LLMs on Kubernetes, will be used to ensure that chat interactions are not sent out of the cluster.

![Screenshot](../screenshots/private-deep-chat.png)

Expand Down Expand Up @@ -72,6 +72,8 @@ kubectl port-forward svc/private-deep-chat 8000:80

In your browser, navigate to <a href="http://localhost:8000/" target="_blank">localhost:8000</a>.

NOTE: Your first interaction with a given model may take a minute as the model needs to scale from zero. Use `kubectl get pods` to check the scale up progress.

Login as any of the following users:

|User|Password |
Expand All @@ -80,4 +82,4 @@ Login as any of the following users:
|sam |samspass |
|joe |joespass |

These users each have access to different KubeAI Models. You can see this assignment by looking at the user mapping in `./main.go` and the associated `tenancy` label on the Models in `./manifests/models.yaml`.
These users each have access to different KubeAI Models. You can see this assignment by looking at the user mapping in `./main.go` and the associated `tenancy` label on the Models in `./manifests/models.yaml`.

0 comments on commit c287c12

Please sign in to comment.