Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[together ai] restore :end_sequence_encountered support #1

Open
kristoph opened this issue Oct 20, 2024 · 0 comments
Open

[together ai] restore :end_sequence_encountered support #1

kristoph opened this issue Oct 20, 2024 · 0 comments
Assignees
@kristoph
Labels
unexpected behavior Adapter behavior with it questionable or unexpected.

Comments

@kristoph
Copy link
Contributor

The Together AI API, with the Llama 3.1 Turbo models, returns an :eos finish_reason as well as a :stop finish reason allowing us to support :end_sequence_encountered.

Unfortunately, other models, such as the Llama 3.1 vision models, do not support this so I've removed support for end_sequence_encountered for now pending clarity from Together Ai.
@kristoph kristoph added the question Further information is requested label Oct 20, 2024
@kristoph kristoph self-assigned this Oct 20, 2024
@kristoph kristoph added unexpected behavior Adapter behavior with it questionable or unexpected. and removed question Further information is requested labels Oct 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@kristoph kristoph

Labels
unexpected behavior Adapter behavior with it questionable or unexpected.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@kristoph