Skip to content

Program Chat Conversation Persistence? #192

Closed Answered by chrisfentiman
rickbraddy-pharma asked this question in Q&A
Discussion options

You must be logged in to vote

@rickbraddy-pharma - it's up to you what is best based on your application needs.

For example, we have a chat application that creates context per request, so instead of having a long-running conversation in one thread, we do a linear execution of the prompt and dynamically fill in the chat context. Each new message is stored, and we build the chat history in context when the next request comes in. This enables you to build robust chat applications. However, this is just a chat example. The great thing about guidance is that you're completely in control and need to find the best way to accomplish your goal.

Replies: 2 comments 1 reply

Comment options

You must be logged in to vote
1 reply
@rickbraddy-pharma
Comment options

Comment options

You must be logged in to vote
0 replies
Answer selected by rickbraddy-pharma
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants