Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

default maxTokens setting for autocomplete #4448

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

ferenci84
Copy link
Contributor

Description

Default maxTokens at 256 for autocomplete if there is no overriding user setting for the model. Added autoCompleteMaxTokens

Change from this comment:
#3994 (comment)

Checklist

  • The relevant docs, if any, have been updated or created - let's create a separate issue for this once the PR is approved and autoCompleteMaxTokens setting is kept in the completion options.
  • The relevant tests, if any, have been updated or created - no relevant tests as far as I know

Testing instructions

I tested by directly putting a log message into the Ollama._streamFim() method.

Copy link

netlify bot commented Mar 3, 2025

Deploy Preview for continuedev canceled.

Name Link
🔨 Latest commit 7eeb5c6
🔍 Latest deploy log https://app.netlify.com/sites/continuedev/deploys/67c5e2b5786e7a0008238157

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant