Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Support for Claude API via Bedrock and Proxy Configuration #68

Open
FamousMai opened this issue Jan 20, 2025 · 2 comments

Comments

@FamousMai
Copy link

Feature Request

I notice that Eino currently supports OpenAI and Azure OpenAI integration. I would like to request the following features:

  1. Claude API Integration via Amazon Bedrock

    • Support for Claude API calls through Amazon Bedrock integration
    • Similar to the existing OpenAI/Azure implementation pattern
  2. Proxy Configuration for Claude API

    • Add proxy configuration support for Claude API calls
    • This is particularly important as Claude API access can be unstable in certain regions
    • Would help improve reliability and accessibility for users in different geographical locations

Benefits

  • Expanded LLM provider options for users
  • Better accessibility in regions with connection issues
  • Consistent integration pattern across different LLM providers

Use Case

This would be particularly beneficial for users who:

  • Want to use Claude's capabilities through Amazon Bedrock
  • Need stable API access in regions with connectivity challenges
  • Are looking to implement multi-model solutions

Would greatly appreciate if these features could be considered for future development.

@shentongmartin
Copy link
Contributor

We have a Claude ChatModel implementation at https://github.com/cloudwego/eino-ext/blob/main/components/model/claude/claude.go.

@FamousMai
Copy link
Author

#76

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

2 participants