anthropic: Add support for multi content part and images content in human messages. #1141
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
As of now there wasn't an option to add an image to a Human message to the anthropic client.
Only text chat messages could be sent.
This PR will resolve two issues of the current implementation of
handleHumanMessage
.It will also add the
anthropic-vision-example
exampleLooking at the documentation we can see that there is two way of sending content through the API:
or
but only the first case was currently supported.
One of the content type that can be set is
image
example:
This feature will be also implemented with this PR, allowing to send Human Chat messages that also integrate images.
I actually needed this feature for my own project, this is how I discovered and fixed the issue.
PR Checklist
memory: add interfaces for X, Y
orutil: add whizzbang helpers
).Fixes #123
).golangci-lint
checks.