Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Add pricing for "DeepSeek-R1-Distill-Llama-8B" for Bedrock #8212

Open
BhargavModha-Cactus opened this issue Feb 3, 2025 · 0 comments
Labels
enhancement New feature or request

Comments

@BhargavModha-Cactus
Copy link

The Feature

It appears that the model "DeepSeek-R1-Distill-Llama-8B" is not present in the model_prices_and_context_window.json file. This issue prevents users from accessing the associated pricing and context window information for the model, which seems to be expected to be available. Model is imported through custom models on bedrock.

Motivation, pitch

  • Missing the DeepSeek-R1-Distill-Llama-8B entry leads to inaccurate pricing and token calculations in litellm.
  • The model is highly demanded due to its innovative reasoning and cost-effectiveness.

Are you a ML Ops Team?

No

Twitter / LinkedIn details

No response

@BhargavModha-Cactus BhargavModha-Cactus added the enhancement New feature or request label Feb 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant