Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[agent farm] cache point in anthropic client #2026

Closed
maan2003 opened this issue Feb 9, 2025 · 2 comments · May be fixed by #2027
Closed

[agent farm] cache point in anthropic client #2026

maan2003 opened this issue Feb 9, 2025 · 2 comments · May be fixed by #2027

Comments

@maan2003
Copy link
Contributor

maan2003 commented Feb 9, 2025

in anthropic client: cache points is used for text message content but not images and tools content types. Add cache points to those
@theskcd
Copy link
Contributor

theskcd commented Feb 9, 2025

ACK, on it!

@theskcd
Copy link
Contributor

theskcd commented Feb 9, 2025

🔧 Cache Enhancement: Added cache control support for images and tools in the Anthropic client

  • Updated: AnthropicMessageContent enum to include cache_control field for all content types (text, images, tools, and tool returns)
  • Modified: Message processing logic to consistently apply cache points across all content types while maintaining existing text caching behavior

👥 Review welcome on these changes which extend our caching capabilities uniformly across content types.

@theskcd theskcd mentioned this issue Feb 9, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
2 participants
@theskcd @maan2003