Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Theia AI] Show the used context in the AI chat response #14961

Open
Tracked by #14923
planger opened this issue Feb 18, 2025 · 0 comments
Open
Tracked by #14923

[Theia AI] Show the used context in the AI chat response #14961

planger opened this issue Feb 18, 2025 · 0 comments
Labels

Comments

@planger
Copy link
Contributor

planger commented Feb 18, 2025

Extend the chat response with a property that tracks the used context and provide an API for agents, chat service and tool functions to track which context variables they've actually resolved while creating the response. Then show this used context as part of the response.


I think it's very important for the release that we have a clear and understandable UX for the context as otherwise we will get a lot of issues reported that the feature is not working.

I absolutely agree. Doing this upfront, however, may require a lot of flags that each agent needs to provide. I think one option that is easier to do generically is to add an indicator in the response which context was processed.

We could track the variable resolution for a request in the chat service and the tool functions could notify the chat model that they've consumed a specific context. We could add an additional processedContext property in the chat response model that is written to by the chat service on variable resolution and by the tool functions and show the tracked context accesses in the chat response.

Originally posted by @planger in #14787 (comment)

@JonasHelming JonasHelming changed the title Show the used context in the AI chat response [Theia AI] Show the used context in the AI chat response Feb 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant