Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: Add Support for 'think' Tag to Display Processing Time #255

Open
victorcomposes opened this issue Jan 30, 2025 · 0 comments

Comments

@victorcomposes
Copy link

I would like to propose the implementation of a feature that supports the use of a think tag in the output. This tag should visually indicate the time the model spends "thinking" or processing a request, without displaying the detailed reasoning content until the next interaction turn.

The think tag would improve how users experience things by:

  • It would show users that the model is working on their request.
  • Creating a more streamlined and focused interaction
  • Allowing users to see the time taken for the model to generate a response
  • Separating the processing phase from the detailed reasoning phase

Expected Behavior:

  1. When the think tag is present in the user's input, the system should:
  • It would only show how long it took to process (e.g., "Processed in 2.5 seconds").
  • Ensure a smooth transition to the next response
  1. If the think tag is missing, the system should work normally and give the full response.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant